-- Logs begin at Wed 2022-06-15 13:46:36 UTC, end at Wed 2022-06-15 15:08:20 UTC. -- Jun 15 14:32:41.926941 dv-cinder-787296-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 14:32:41.937463 dv-cinder-787296-10-smb devstack@keystone.service[87004]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:32:41 2022] *** Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: nodename: dv-cinder-787296-10-smb Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: machine: x86_64 Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: clock source: unix Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: pcre jit disabled Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: detected number of CPU cores: 4 Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: current working directory: / Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: your processes number limit is 47680 Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: your memory page size is 4096 bytes Jun 15 14:32:41.939949 dv-cinder-787296-10-smb devstack@keystone.service[87004]: detected max file descriptor number: 2048 Jun 15 14:32:41.940799 dv-cinder-787296-10-smb devstack@keystone.service[87004]: lock engine: pthread robust mutexes Jun 15 14:32:41.940799 dv-cinder-787296-10-smb devstack@keystone.service[87004]: thunder lock: enabled Jun 15 14:32:41.940799 dv-cinder-787296-10-smb devstack@keystone.service[87004]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 14:32:41.940799 dv-cinder-787296-10-smb devstack@keystone.service[87004]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:32:41.985345 dv-cinder-787296-10-smb devstack@keystone.service[87004]: Python main interpreter initialized at 0x563c3d8119c0 Jun 15 14:32:41.985345 dv-cinder-787296-10-smb devstack@keystone.service[87004]: python threads support enabled Jun 15 14:32:41.985345 dv-cinder-787296-10-smb devstack@keystone.service[87004]: your server socket listen backlog is limited to 100 connections Jun 15 14:32:41.985345 dv-cinder-787296-10-smb devstack@keystone.service[87004]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:32:41.985705 dv-cinder-787296-10-smb devstack@keystone.service[87004]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:32:41.985705 dv-cinder-787296-10-smb devstack@keystone.service[87004]: *** Operational MODE: preforking *** Jun 15 14:32:41.985993 dv-cinder-787296-10-smb devstack@keystone.service[87004]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:32:41.985993 dv-cinder-787296-10-smb devstack@keystone.service[87004]: spawned uWSGI master process (pid: 87004) Jun 15 14:32:41.986204 dv-cinder-787296-10-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 15 14:32:41.991837 dv-cinder-787296-10-smb devstack@keystone.service[87004]: spawned uWSGI worker 1 (pid: 87016, cores: 1) Jun 15 14:32:41.991837 dv-cinder-787296-10-smb devstack@keystone.service[87004]: spawned uWSGI worker 2 (pid: 87017, cores: 1) Jun 15 14:32:41.991837 dv-cinder-787296-10-smb devstack@keystone.service[87004]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:32:47.662842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:32:47.662842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: from cryptography.utils import int_from_bytes Jun 15 14:32:47.663636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:32:47.663636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: from cryptography.utils import int_from_bytes Jun 15 14:32:47.664531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:32:47.664531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: from cryptography.utils import int_from_bytes Jun 15 14:32:47.664988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:32:47.664988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: from cryptography.utils import int_from_bytes Jun 15 14:32:47.713059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:32:47.713256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:32:47.713450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] command line args: [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:32:47.713725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:32:47.713905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ================================================================================ {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:32:47.714163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] admin_token = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.714414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] config_dir = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.714524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:32:47.714605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.714717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:32:47.714835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] config_source = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.714912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] command line args: [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:32:47.714992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] debug = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:32:47.715388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ================================================================================ {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:32:47.715508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] admin_token = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] config_dir = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.715971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] config_source = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] debug = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_config_append = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.716937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_dir = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_file = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_config_append = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.717987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_dir = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_file = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.718994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.719833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.720954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] publish_errors = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.721921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] publish_errors = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] standard_threads = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.722978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723267 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] use_journal = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] use_json = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] standard_threads = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] use_stderr = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.723994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] use_syslog = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.724139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.724235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.724422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.724582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.724762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] use_journal = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.724941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] use_json = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.725239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] use_stderr = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.725338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] use_syslog = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.725537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:32:47.725738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.725968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.726966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.727967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.728960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.729798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.730452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.730563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.730706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.730837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.730951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.731974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.732914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.733997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.734918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.735978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.736940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.737978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.738877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.739755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.740907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.741880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.742995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.743947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.744995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.745108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.745742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.745860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.745983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.746920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.747951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.748886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.749811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.750095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.750354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.750626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.750908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.external = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.751948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.password = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.external = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] auth.token = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.752952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.password = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] auth.token = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.753999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.754931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.755047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.755162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.755775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.755978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.757888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.758893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.759975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.760948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.761914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.762965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.763895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.764931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.765965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.766989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.767932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.768969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.769890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.770801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.771578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.771705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.771885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.772976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.773893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.774925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.775965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.776999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.777919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.778947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.779887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.780915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.781897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.782927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.783996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.784921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] role.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] role.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.785963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.786969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] role.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] role.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.787888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.788935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.789951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.790978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.791937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.792982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.793904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.794942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.795984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.796911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.connection = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.797954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.798881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.connection = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.799909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.800883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.801931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:32:47.802809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.802809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.803132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.803311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.803555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.803794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:32:47.803992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:32:47.919554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.919740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.919956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.922240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.922477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.922707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.928572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.931567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.957285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.957511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.959592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:47.959857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.012573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.012970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.061759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.061990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.063013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.063248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.128914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.129971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.130070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.130190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.131110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.153807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.154938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.155021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.155156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.155237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.155392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.166325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.167009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.180968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.181837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87016) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 14:32:48.199616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.199849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 14:32:48.199935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.200066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 14:32:48.200196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.200400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 14:32:48.200482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.200599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 14:32:48.200852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.201840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.212691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.212971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.213786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.221670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.221896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.225382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.225660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.225774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.225946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.226857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.227973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.228157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.228238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.228422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.255982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.256824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.257627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.257912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.258461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.258743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.263206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.263486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.263826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.264045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.264323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.264605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.271303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.271586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.272357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.272642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.276139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.276432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.276720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.277264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.277815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.278013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.278097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.278287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.278560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.278830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.279094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.296825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.297105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.298177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.298456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.301688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.303918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.306019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.306314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.307600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.307923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.311471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.313083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.315109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.316737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.319647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.319969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.320255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.320535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.320809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.321086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.321411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.321709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.321994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.322274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.322548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.322820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.340776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.341057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.341323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.341595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.342693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.342975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.343240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.343501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.349729 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.351446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.351744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.351855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.353569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.353845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.354843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.355125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.356853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.356939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.357155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.357239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.357450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.358884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.359180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.359460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.371490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.371772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.372081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.372360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.372645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.372924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.373200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.373814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.374091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.374366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.374642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.374919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.375192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.375465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.392157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.394459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.395442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.398091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.398878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.400521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.401450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.402481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.402832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.403246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.403318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.405059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.405347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.405631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.413363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.414992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.417650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.418285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.418578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.418983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.419439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.420196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.423388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.423676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.423986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.424268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.429765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.430047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.430372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.437224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.437519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.437802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.438351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.438628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.438905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.439188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.439459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.439750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.440046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.440319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.440591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.440958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.441233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.441505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.441772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.442033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.446494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87016) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 14:32:48.446776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.447059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.447340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.447612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.447930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.448206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.448486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.449022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.449390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.449665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.449932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.450200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.450478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87016) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 14:32:48.482314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563c3d8119c0 pid: 87017 (default app) Jun 15 14:32:48.485795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff32e2-947f-4f4f-903f-8d5d52bff5c2 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:32:48.486088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff32e2-947f-4f4f-903f-8d5d52bff5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:32:48.486365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff32e2-947f-4f4f-903f-8d5d52bff5c2 None None] PATH_INFO: `/v3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:32:48.488856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563c3d8119c0 pid: 87016 (default app) Jun 15 14:32:48.491389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Jun 15 14:32:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:32:57.343263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:32:57.343848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:32:57.343848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:32:57.348112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:32:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:32:57.353524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:32:57.353913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:32:57.354082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:32:57.425596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: INFO dbcounter [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] Registered counter for database keystone Jun 15 14:32:57.448175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:32:57.454826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writer thread running {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:32:57.635872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG passlib.handlers.bcrypt [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87017) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 14:32:57.636217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG passlib.handlers.bcrypt [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87017) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 14:32:57.691643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:32:57.693521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:32:57.817706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:32:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 14:32:57.968282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:32:58.041257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: INFO dbcounter [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] Registered counter for database keystone Jun 15 14:32:58.060740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG oslo_db.sqlalchemy.engines [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:32:58.067000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writer thread running {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:32:58.189379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574147-f0d7-4dd9-b32d-42054e657ac3 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:32:58.194044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:32:58.194705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:32:58.194990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:32:58.195265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:32:58.203875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:32:58.258461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 14:32:58.258733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2a48-b1ce-4299-b0c8-52651b897b40 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:32:58.268666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Jun 15 14:32:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:32:58.275362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:32:58.292407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ff311-8b48-493f-b474-1e116ff8df3e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:32:58.297141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:32:58.298338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:32:58.298615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:32:58.298887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] PATH_INFO: `/v3/projects/8e584b507784426894a201cd6de6602d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:32:58.300499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] RBAC: Authorizing `identity:get_project(project_id=8e584b507784426894a201cd6de6602d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:32:58.353720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 14:32:58.354277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a3192-222f-4c23-b68b-4b529ccfaa8e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:32:58.358678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Jun 15 14:32:58 2022] GET /identity/v3/projects/8e584b507784426894a201cd6de6602d => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:00.497967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6577df-646a-4d5d-ae0d-33af39039294 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:00.498518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6577df-646a-4d5d-ae0d-33af39039294 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:00.498518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6577df-646a-4d5d-ae0d-33af39039294 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:00.502652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:00.509417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:00.509854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:00.509972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:00.528538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:00.530051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:00.538492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 15 14:33:00.561472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6577df-646a-4d5d-ae0d-33af39039294 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:00.573568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6577df-646a-4d5d-ae0d-33af39039294 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:00.578004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:00.578643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:00.578926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:00.579238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:00.587527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:00.589357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88244144-08e4-465f-989b-23fddd7fc4bc admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:00.598052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Jun 15 14:33:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:33:00.604141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:00.613353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7e18a-c211-401c-8ee3-1f7c5d96b5bf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:00.618602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:00.619473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:00.619759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:00.620068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:00.621489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:00.623341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012d91-065e-466a-bef5-669b47c979a9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:00.624989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Jun 15 14:33:00 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:02.848702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a3e7-7594-4ea5-b4b1-d14937c81791 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:02.849393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a3e7-7594-4ea5-b4b1-d14937c81791 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:02.849393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a3e7-7594-4ea5-b4b1-d14937c81791 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:02.850983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:02.856494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779da0-d666-4431-b819-16c72d937948 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:02.856925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779da0-d666-4431-b819-16c72d937948 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:02.857053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779da0-d666-4431-b819-16c72d937948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:02.860021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82a01-530a-43aa-9481-1761472aac15 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:02.860314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82a01-530a-43aa-9481-1761472aac15 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:02.860595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82a01-530a-43aa-9481-1761472aac15 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:02.861861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:02.867286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:02.867580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:02.867889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:02.874973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3f779da0-d666-4431-b819-16c72d937948 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:02.876201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3f779da0-d666-4431-b819-16c72d937948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:02.910402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG passlib.handlers.bcrypt [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87016) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 14:33:02.910830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG passlib.handlers.bcrypt [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87016) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 14:33:02.957155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:02.958862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:02.967876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:02.992275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779da0-d666-4431-b819-16c72d937948 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.016239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.063513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:03.086315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.099571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779da0-d666-4431-b819-16c72d937948 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.136756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.137555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.137836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.138107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.151234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:03.163304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:03.164263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:03.165365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:03.170460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.225682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499ab80-4ad2-4f42-b1da-54399cb1982a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.228088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.260383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.267829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.268806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.269135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.269411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.279581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f90c5-b7e9-4839-9d10-e53966959bb7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.317821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.318495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.318781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.319570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.320562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:03.320874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.322309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.335085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:03.340610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.358196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.361135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.447834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c229d-1f92-49d1-9213-e810ae1da36c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.467636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 14:33:03.473716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.477425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.482513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.483469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.493535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.493535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.493535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.493535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.493535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:03.494486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.510270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.578752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624790-fd78-4f4f-9a81-7b78ca09d6cd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.597571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e32be-f356-432a-bbf4-6be4837c7245 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.617650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.618457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.618778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.619020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.636778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.637598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.637883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.638161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.638602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.639399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.640146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.640907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.642749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:03.649172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:33:03.662759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:03.663643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:03.664485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:33:03.664485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:33:03.664485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:33:03.664485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:03.664485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:03.669876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:03.732343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.737870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:03.758724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63b513-d213-47af-bcb5-55fe12d06bb0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.784931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576f6b1-d3b9-473d-a674-ac4e3fbcd12e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:03.794631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.795298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.798586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.798586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.798586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.domain.id=default, user.id=454ed721dbd84dcaa08428c7e40647f6) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:03.798586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.798586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4cbec-ca8a-43cf-ba59-1715676a25c8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.808800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/role_assignments?user.id=454ed721dbd84dcaa08428c7e40647f6&scope.domain.id=default&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:03.825025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:03.825723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:03.826032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:03.826312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:03.827110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:03.827420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:03.828969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1691f25-cb1a-4acb-abf8-8c14df1e914c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:03.850911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:06.683581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d7f4b-bd1c-40b8-9aaf-76be2b972376 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.684641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d7f4b-bd1c-40b8-9aaf-76be2b972376 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.685153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d7f4b-bd1c-40b8-9aaf-76be2b972376 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.687004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:06.692652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b33df-54e4-4fb1-a04d-f5d3039209c0 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.693498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b33df-54e4-4fb1-a04d-f5d3039209c0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.693979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b33df-54e4-4fb1-a04d-f5d3039209c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.705625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c7de-258c-4f97-abc2-8d6b71dcb034 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.706161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c7de-258c-4f97-abc2-8d6b71dcb034 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.706637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c7de-258c-4f97-abc2-8d6b71dcb034 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.710246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:06.713939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.716173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.716699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.740277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a28b33df-54e4-4fb1-a04d-f5d3039209c0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:06.745842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a28b33df-54e4-4fb1-a04d-f5d3039209c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:06.763347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:06.764570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:06.872531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:06.873887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41139-c507-4b67-9dcc-20ba974c8d2d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.874183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41139-c507-4b67-9dcc-20ba974c8d2d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.874472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41139-c507-4b67-9dcc-20ba974c8d2d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.875966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 12/25] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:06.882340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:06.882855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:06.883329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:06.914142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:06.915340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:06.936283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:06.937049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.000700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:07.046898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:07.047761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.098731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:07.134492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b2e9-6ba6-4100-8924-f5a8ff10acda None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.197638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dc92b-19df-4c60-b226-0c2ce9cbf179 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.220562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:07.221263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.221552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.221831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.222602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:07.224096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:07.235785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:07.242131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.242131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.242131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.250558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:07.260783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:07.261670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:07.262504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 14/28] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:07.263127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.303136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:07.442218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b914e-a29a-410f-a7ce-b57b4e60369f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.516755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:07.517520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.517811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.518091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.536464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:07.538613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:07.577906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jun 15 14:33:06 2022] POST /identity/v3/roles => generated 219 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:07.578950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:33:07.581431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:07.584156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:07.586405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:33:07.586405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:33:07.586405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:33:07.586405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:07.586405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 15/30] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:07.591846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.754921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480758b-00c0-4e68-8a4a-f95714b5a049 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.766466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:07.789956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498cbf6-5a19-4e07-bc36-67ce7d748cae None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.800471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:07.801171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.801454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.801730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.803316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:07.803761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:07.805390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011f37-d5c7-4afc-b0e9-3b022476253a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:07.807130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:07.816548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:07.822227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df894-f896-4eb6-bade-8bd1f0230bed None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.822227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df894-f896-4eb6-bade-8bd1f0230bed None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.822227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df894-f896-4eb6-bade-8bd1f0230bed None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.822227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 17/32] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:07.826469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df894-f896-4eb6-bade-8bd1f0230bed None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:07.865525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:07.866600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.867032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.867448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.868349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:07.868664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:07.870075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ae90-1b33-454b-b528-ea78007bc6d2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:07.887009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 16/33] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:07.887718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05cf15-e871-447e-b91e-ec9f7da56f93 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.888096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05cf15-e871-447e-b91e-ec9f7da56f93 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.888383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05cf15-e871-447e-b91e-ec9f7da56f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.907618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ce05cf15-e871-447e-b91e-ec9f7da56f93 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:07.909336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ce05cf15-e871-447e-b91e-ec9f7da56f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:07.961598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df894-f896-4eb6-bade-8bd1f0230bed None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:07.989746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:07.991989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c36a-3c10-403f-ad6f-af4cacad9af6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:07.991989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c36a-3c10-403f-ad6f-af4cacad9af6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:07.991989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c36a-3c10-403f-ad6f-af4cacad9af6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:07.997172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 18/35] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:07.997172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c36a-3c10-403f-ad6f-af4cacad9af6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.017247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.018217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.018547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.018827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.020361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.022801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b0431-97ea-4d63-84bc-a45d4c66656c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.025697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 18/36] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:07 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:08.027046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.027340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.027652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.048328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:08.049798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:08.091371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:08.115134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:08.115318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c36a-3c10-403f-ad6f-af4cacad9af6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.123539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:08.128414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.153047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.153723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.154044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.154292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.155261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.156805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.256171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61231-4a59-42fa-b0ca-59e637ffcf72 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.289908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.290573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.290854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.291126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.291901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.293358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.399582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 20/38] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jun 15 14:33:08 2022] POST /identity/v3/roles => generated 223 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:08.416722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.487575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:08.532646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:33:07 2022] POST /identity/v3/projects => generated 301 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:08.533474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.559207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4b3b-0825-4f81-ae6e-867956ef1c35 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.617197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.618148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.618415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.618597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.623981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.623981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226bf5-9a8d-49c1-8b15-78faf793225b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.623981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 21/40] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:08.624640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa555-e48b-4889-ab72-96bfcbfbc276 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.624931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa555-e48b-4889-ab72-96bfcbfbc276 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.625338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa555-e48b-4889-ab72-96bfcbfbc276 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.626656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 22/41] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:08.633749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.634046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.634311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.657612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:08.659174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:08.693071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9807b-a4e5-4c70-ba45-bca784aae1d2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.730518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:08.736568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.737259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.737550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.737832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.738597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.740779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.749291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 23/42] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:08.750733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.806566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:08.839916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 20/43] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jun 15 14:33:08 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:08.840754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:08.860360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bf71-f261-43d2-9b3c-341b53eb67d1 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.900799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:08.901728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:08.902043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:08.902318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] PATH_INFO: `/v3/domains/default/users/454ed721dbd84dcaa08428c7e40647f6/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:08.904611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=454ed721dbd84dcaa08428c7e40647f6, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:08.906122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:08.962159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56b359-c05f-4750-a842-aaf5005e4c4c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:08.977087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 24/44] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Jun 15 14:33:08 2022] PUT /identity/v3/domains/default/users/454ed721dbd84dcaa08428c7e40647f6/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:09.003935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:09.004777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:09.005071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:09.005380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:09.007482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:09.009023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d265f-efe0-40b5-860a-ef208a1f95e4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:09.010770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 21/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:09.016897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:09.136763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4155e1-6f9f-418c-9278-e72eb703e3f7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:09.153010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:09.174917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a01966-bd15-4025-af7e-339632c486af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:09.175597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01966-bd15-4025-af7e-339632c486af None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:09.176024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01966-bd15-4025-af7e-339632c486af None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:09.176306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01966-bd15-4025-af7e-339632c486af None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:09.177044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01966-bd15-4025-af7e-339632c486af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:09.178772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01966-bd15-4025-af7e-339632c486af None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:09.302088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 25/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:33:09 2022] POST /identity/v3/projects => generated 312 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:11.106340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681139c3-a3fe-4e0d-9880-3e34099bbd06 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.106844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681139c3-a3fe-4e0d-9880-3e34099bbd06 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.106944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681139c3-a3fe-4e0d-9880-3e34099bbd06 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.108436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 22/47] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:11.113755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.114130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.114447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.131708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:11.132948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:11.203174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 26/48] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:11.227495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681139c3-a3fe-4e0d-9880-3e34099bbd06 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.294159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.336929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681139c3-a3fe-4e0d-9880-3e34099bbd06 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.371375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.372148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.372438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.372722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.385364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6ff402ab-d963-4c5c-85d6-eb598486f29b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:11.393224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:11.394266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:11.395098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 23/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:11.401446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.436300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda50a-2388-4e5e-9403-8e2a0a4bc2f0 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.436588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda50a-2388-4e5e-9403-8e2a0a4bc2f0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.436864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda50a-2388-4e5e-9403-8e2a0a4bc2f0 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.438236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 24/50] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:11.443243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.443753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.444079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.462136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:11.463781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:11.496596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.503386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3f47-0d91-4392-b02b-d2d76f41dacb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.533924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 25/51] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:11.537328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.538111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.538403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.538683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.539446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:11.539761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:11.541202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:11.549398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:11.554863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.557782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.606725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.657329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aa5ff-c4b5-48f2-85e6-e19afb4b9d04 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.658357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929564fb-3797-449e-9629-07aa5e43c336 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.692580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.693068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.693501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.693791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.693888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.694071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.694156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.694396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.695536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:11.695630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:11.697075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:11.697162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:11.699310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:11.699412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:11.704714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.704848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.732947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.806543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270838e4-7063-4eb7-86ff-dd33af28e6e6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.809645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21219-bb1e-4f8c-a834-9e7721935004 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.823179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.841589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.842421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.842709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.842991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.843706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:11.844696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.845186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00105ed5-a085-4ca9-bb99-75973dbb2bc9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:11.845486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:11.845767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:11.846039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:11.847210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:11.848691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:11.850528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:11.856538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:11.936403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 27/56] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Jun 15 14:33:11 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:11.951606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:11.961931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53feff3-ed87-4a72-94df-6231e5d799fe None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:11.999032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:11.999708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:12.000029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:12.000312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:12.001173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.domain.id=default, user.id=454ed721dbd84dcaa08428c7e40647f6) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:12.001489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:12.002976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457916f-aadc-4404-8b69-854913f0d364 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:12.010252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 30/57] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Jun 15 14:33:11 2022] GET /identity/v3/role_assignments?user.id=454ed721dbd84dcaa08428c7e40647f6&scope.domain.id=default&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:14.080880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c954-c3a8-4f33-9fa3-c8db74774320 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:14.081429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c954-c3a8-4f33-9fa3-c8db74774320 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:14.081429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c954-c3a8-4f33-9fa3-c8db74774320 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:14.082722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:14.088166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:14.088567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:14.088737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:14.106298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:14.107507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:14.174787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:14.205335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7c954-c3a8-4f33-9fa3-c8db74774320 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:14.307726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7c954-c3a8-4f33-9fa3-c8db74774320 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:14.340954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:14.341745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:14.342032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:14.342310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:14.343498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:14.345012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069ed99-4d0c-45ec-8ff9-c2522cd7a304 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:14.346623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:14.352925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:14.433548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:14.447451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d26e9-f8ff-4bac-b9bf-9ae718526ecd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:14.481133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:14.481787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:14.482069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:14.482345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:14.483064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:14.484532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8700cdd-11d1-4b1b-b1b2-f0f5f0fcd06b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:14.593266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:14 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:17.847324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fa3a-8300-47cd-8b05-31b39ba29bb2 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:17.847886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fa3a-8300-47cd-8b05-31b39ba29bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:17.847886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fa3a-8300-47cd-8b05-31b39ba29bb2 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:17.849813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:17.860515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4f71-656f-4c9d-990b-7ad4f3203f3a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:17.861074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4f71-656f-4c9d-990b-7ad4f3203f3a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:17.861074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4f71-656f-4c9d-990b-7ad4f3203f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:17.884881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e81e4f71-656f-4c9d-990b-7ad4f3203f3a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:17.886108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e81e4f71-656f-4c9d-990b-7ad4f3203f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:17.982813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:18.003215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117895-d395-4460-814e-71e2d2b3ae95 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.003837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117895-d395-4460-814e-71e2d2b3ae95 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.004316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117895-d395-4460-814e-71e2d2b3ae95 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.006281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 31/64] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:18.011910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870019a-fdf4-4a95-8e09-d51483e2caec None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.012205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870019a-fdf4-4a95-8e09-d51483e2caec None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.012486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870019a-fdf4-4a95-8e09-d51483e2caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.022060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117895-d395-4460-814e-71e2d2b3ae95 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.047768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f870019a-fdf4-4a95-8e09-d51483e2caec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:18.049095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f870019a-fdf4-4a95-8e09-d51483e2caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:18.095566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.173621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:18.175603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e6bc-e4cc-4f5b-b978-a7f9ad91e022 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.176142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e6bc-e4cc-4f5b-b978-a7f9ad91e022 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.176481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e6bc-e4cc-4f5b-b978-a7f9ad91e022 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.182142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 35/66] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:18.184051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.184543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.185028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.190524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.195160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117895-d395-4460-814e-71e2d2b3ae95 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.205112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:18.206526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:18.233650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.234812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.235256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.235710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.247572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:18.256290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:18.257187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:18.257936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:18.261209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 32/67] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:18.262396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.287413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 36/68] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:18.287413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.399299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c727-ae06-4518-9add-283e9fd10080 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.399482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0195a9-25a6-42b6-8940-72c5c2af2040 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.416267 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.437679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.448774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.457892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.458051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.458051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.458051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.458276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.458276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.458276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.458452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:18.458452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:18.458452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:18.464066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 37/69] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:18.464781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:18.465483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:18.474590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:18.475611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 33/70] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:18.476386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.587588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef693-782f-4696-bdc0-fae2b25ca4b6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.601566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801abc3-25a8-4ecf-bf78-1beb2602730e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.628438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.629318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.629607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.629893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.638875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.639978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.640401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.640811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.646986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:18.648633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:18.650406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 34/71] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:18.651183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.652675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-00f39479-3a33-4a96-b320-961751d896bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:18.660958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:18.662754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:18.663498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 38/72] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:18.665572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79dcee-a82e-4207-be5c-bbf081fea266 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.665875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79dcee-a82e-4207-be5c-bbf081fea266 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.666155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79dcee-a82e-4207-be5c-bbf081fea266 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.668055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 39/73] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:18.669066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ee64-3840-4749-8910-9f57bc83247b None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.669308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ee64-3840-4749-8910-9f57bc83247b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.669587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ee64-3840-4749-8910-9f57bc83247b None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.670653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.671081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 40/74] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:18.672041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08ee64-3840-4749-8910-9f57bc83247b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.732620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.764442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2f968-085b-4577-98b5-0a7a1a13aa2e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.793512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08ee64-3840-4749-8910-9f57bc83247b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.803034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.803715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.804028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.804330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.805083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:18.805390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:18.806765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:18.826294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 35/75] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:18.826294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:18.838142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.839082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.839502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.839834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.913480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.915287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:18.916805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aa31d-f82f-43a5-9a3a-40d55410511d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:18.935325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f35a4-5bfc-4d6f-b27d-b6d37acf7ba4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:18.970015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:18.970687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.970871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:18.970989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.971228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:18.972005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:18.972310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:18.973686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e877d-0d1a-4edf-8be5-7b9043905d0a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:18.982668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 36/76] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:18.985097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:18.985394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:18.985682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.002368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:19.003589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:19.017524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 41/77] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:19.018795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.019082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.019358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.037219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:19.038419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:19.076252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 37/78] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:19.077180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.118973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 42/79] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:19.119745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.145049 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.181923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4b7e6-fed8-404f-b584-a00e31a7a3eb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.227587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.230113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.231076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.231455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.231812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.233138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.234615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.236310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 38/80] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:19.237831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.244683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5b219-3ad3-4925-99b5-8d9e7e6ebbe6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.279623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.280529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.280809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.281082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.282277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.283746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.285417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 43/81] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:19.286184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.342955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16577e-9b86-45b5-8993-7e12b1a8e926 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.378536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.379313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.379598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.379905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.381430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.382895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.384854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 39/82] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:19.385482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.388929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.395648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b6ce-2316-444a-98c5-919a8eb8826d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.435593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.436432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.436721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.437001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.447240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:19.455196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:19.456063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:19.456863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 44/83] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:19.457505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.472525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.492818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dab-9f95-4094-977a-8364a3da06f8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.529552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.530352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.530635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.530910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.532255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.533733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.535379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 40/84] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:19.536177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.572013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99727423-bcec-4952-9f84-5e375b27d436 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.609599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.610192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.610477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.610757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.610877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.641576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec7fa2-2e24-4102-87eb-e19fc82bd845 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.679492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.680177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.680467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.680750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.684399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.685911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.700167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.751006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.752641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.788266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 45/85] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:19.789139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.828058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.860822 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 41/86] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:19.861681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.911048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bc25d-face-48a5-a4cd-a134c4c06408 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:19.924402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:19.949859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:19.950561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:19.950839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:19.951114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:19.951991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:19.952297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:19.953764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:19.964432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 46/87] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:19.965396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:19.982062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec64f9-c881-425b-a431-de539b6f1094 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.023730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.024452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.024735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.025011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.025929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:20.026241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.027888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.038426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 42/88] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.039460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.085292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:20.102785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e7a9-9ed5-414f-9721-6e8214a246af None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.150163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.261036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.261036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.261036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.261036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.261036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.261438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1fcfe-b49f-4aea-9dd7-9a1ce4fdcd29 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.261438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.261438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.261438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.261714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.261714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.261714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.261714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 43/89] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.261714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.262003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 47/90] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:19 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:20.262003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.291164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:20.349360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c4a8-cb11-4fcc-a5c5-b0ae89f08000 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.351147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:20.374013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8c75-4de4-4fc4-b2c0-378c4d7efd20 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.390917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.392118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.397070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.397070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.397070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.397070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.398187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 44/91] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.398705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.415739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.416658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.416940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.417213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.418541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.420107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.423612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 48/92] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.423612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.526670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3ec4-0c77-42bf-afa8-9731f8b5b967 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.559396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3b6a-2c50-4e5e-9be8-1280ee96e350 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.577841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:20.580167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.580847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.581159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.581442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.583024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=454ed721dbd84dcaa08428c7e40647f6) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:20.583346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.586411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.600267 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 45/93] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/role_assignments?user.id=454ed721dbd84dcaa08428c7e40647f6&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.601133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:20.636549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.637770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.638058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.638643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.640160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:20.640477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.642346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.651820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 49/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:20.656646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:20.747400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2bfe-2c15-45f5-8acf-73c161f983e1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:20.800621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:20.801225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:20.801515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:20.801797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:20.908188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:20.909744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:20.955956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:21.050796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 46/95] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:21.057831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:21.327109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b0ad-8a8d-473d-bea9-e1d0ae41a115 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:21.383797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:21.385075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:21.385569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:21.386054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] PATH_INFO: `/v3/projects/cb5145ecd857453e93341715206c683e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:21.387489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] RBAC: Authorizing `identity:get_project(project_id=cb5145ecd857453e93341715206c683e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:21.389193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b718f0-eac2-4d57-8bbb-04a6b62ed80f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:21.391462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 50/96] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:21 2022] GET /identity/v3/projects/cb5145ecd857453e93341715206c683e => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:21.400597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:21.549383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487e24-2de7-483c-ac5d-3dfa54c5bfdd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:21.602969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:21.603657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:21.603979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:21.604264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:21.605125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=cb5145ecd857453e93341715206c683e, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:21.605447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:21.606927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7791fd1-89e4-4dac-b1d5-9bab8c2fc5ae None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:21.609039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:21.616262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 47/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:21 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=cb5145ecd857453e93341715206c683e&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:22.656104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81b88-d6dd-4885-9c3c-dad3f8e94573 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:22.657169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81b88-d6dd-4885-9c3c-dad3f8e94573 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:22.657679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81b88-d6dd-4885-9c3c-dad3f8e94573 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:22.659297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 51/98] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:22.666231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:22.666745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:22.666836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:22.692825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:22.692825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:22.774644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 48/99] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:22.798219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81b88-d6dd-4885-9c3c-dad3f8e94573 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:22.835581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:22.953143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81b88-d6dd-4885-9c3c-dad3f8e94573 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:23.006280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:23.007088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.007374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.007653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.026906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:23.034805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:23.035737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:23.036567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 52/100] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:23.045160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:23.203328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497991ae-c67b-4683-a619-843aa657edd9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:23.250766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:23.262187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:23.263487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.263487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.263487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.264233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:23.264539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:23.265922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:23.283277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 49/101] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:23.289590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:23.439768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:23.450231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eb050-e591-458a-8e52-2528931766f3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:23.492548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:23.493376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.493662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.493943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.495334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:23.496878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:23.498974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 53/102] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:23 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:23.504141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:23.657206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865755-a31b-40f1-926d-a03d21f67da2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:23.707395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:23.709623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.710131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.710620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.712159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:23.713830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8f9a4-1f6a-4c02-90f3-2069d574ec28 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:23.715767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 50/103] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:23 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:23.721664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:23.888993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286ee5-416a-4987-b33e-e9f543a33674 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:23.943932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:23.944527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.944815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.945096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.953533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, user_id=2827b6c15de64c1f9dea12ca5ccd48ca, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:23.955026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:23.983466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c128bb-c746-4287-98a5-a1a369862c46 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.984108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c128bb-c746-4287-98a5-a1a369862c46 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:23.984605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c128bb-c746-4287-98a5-a1a369862c46 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:23.986252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 51/104] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:23.999050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0f8a-94bb-4630-aa8c-de1e328ab952 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:23.999712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0f8a-94bb-4630-aa8c-de1e328ab952 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.000274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0f8a-94bb-4630-aa8c-de1e328ab952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.031612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a5ad0f8a-94bb-4630-aa8c-de1e328ab952 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:24.033441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a5ad0f8a-94bb-4630-aa8c-de1e328ab952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:24.039852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 54/105] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:23 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:24.102259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.120012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 52/106] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 15 14:33:24.143256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.181311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.253444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ab1-f8d8-4cc7-83c5-300e7b73041b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.253740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ab1-f8d8-4cc7-83c5-300e7b73041b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.254011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ab1-f8d8-4cc7-83c5-300e7b73041b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.255439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 53/107] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:24.264278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.269728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.270312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.288229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:24.289806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:24.305067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f1dd-8832-402b-9533-8333aaa81414 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.354189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:24.355211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.355497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.355777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.371534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:24.374647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 54/108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:24.379903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:24.380999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:24.381944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 55/109] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:24.387630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.403710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.504216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.514739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb281988-6b63-4f5c-9897-8dafac63e4b5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.528487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9352a4-ac34-4b74-9ee1-dcf0d647d63d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.545854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.560227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:24.561083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.561375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.561656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.562692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:24.562885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:24.564410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124642-f3e6-4c7e-93c7-4aec141757b2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:24.573514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:24.574922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.575410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.575928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.582393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 55/110] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:24.584002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59635-df24-4971-97b4-c00206ee76d6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.584428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59635-df24-4971-97b4-c00206ee76d6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.584842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59635-df24-4971-97b4-c00206ee76d6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.586340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 56/111] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:24.587633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895964-e668-48bf-92aa-6b0f5fd9aad6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.590777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:24.592611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895964-e668-48bf-92aa-6b0f5fd9aad6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.593030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895964-e668-48bf-92aa-6b0f5fd9aad6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.594626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 57/112] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:24.599972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069ff1-87e8-476b-adb4-bc5a13e0b891 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.600303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069ff1-87e8-476b-adb4-bc5a13e0b891 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.600591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069ff1-87e8-476b-adb4-bc5a13e0b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:24.601171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:24.602040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:24.602811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:24.605553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 56/113] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:24.606820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.622572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-95069ff1-87e8-476b-adb4-bc5a13e0b891 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:24.624071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-95069ff1-87e8-476b-adb4-bc5a13e0b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:24.702050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 58/114] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:24.703836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.703967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.704228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.722562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:24.723925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:24.725042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206ca7-e488-4737-9ffc-2868fc9f6236 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.773710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:24.774900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.775363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.775867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.777373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:24.779046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:24.780935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 57/115] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:24.781877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.793802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.805038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 59/116] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:24.810302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:24.875560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:24.909689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891519cf-b6ac-45ad-92e0-cdffc1498fb7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.945401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf8509-cd20-47ea-9e5b-8dbb0b8f2ab3 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:24.969691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:24.970679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:24.971166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:24.972205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:24.972838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:24.974392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:24.975895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:24.986801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 58/117] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:24.991932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.002086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.003181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.003667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.004270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.006394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.008158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.010203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 60/118] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:25.011274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.075971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.114432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da6c1-9f64-422f-835f-696eabf7f654 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.135549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b8cb-ed0b-445b-9fca-3421830d3c88 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.145875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.152005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.152885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.153173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.153453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.154737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.156424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.158172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 59/119] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:24 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:25.158951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.180310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.181341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.181895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.182332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.194679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:25.203564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:25.204669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:25.205580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:25.207619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 61/120] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:25.212769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.272375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378d5f-4b8b-43e1-8c5f-5642db783125 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.319719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.320638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.320921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.321198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] PATH_INFO: `/v3/users/d4ff93bae5fd48cb94c863943c00a1dc` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.322707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6884-f5d1-4eb6-8f35-bb18169ee558 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.329755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.335985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ff93bae5fd48cb94c863943c00a1dc)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.337479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85e10-091b-4825-956c-5ea815ad2be1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.339201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 60/121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:25 2022] GET /identity/v3/users/d4ff93bae5fd48cb94c863943c00a1dc => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:25.344835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d604b1-484e-4686-8aef-96eff697886c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.345128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d604b1-484e-4686-8aef-96eff697886c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.345411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d604b1-484e-4686-8aef-96eff697886c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.346821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 61/122] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:25.347380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d604b1-484e-4686-8aef-96eff697886c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.370023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.370818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.371697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.372835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.373573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.375038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.454355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d604b1-484e-4686-8aef-96eff697886c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.464363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 62/123] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:33:25 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:25.465847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.494151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.495147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.495432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.495707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.498245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, user_id=2827b6c15de64c1f9dea12ca5ccd48ca, role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.499967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.511038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.575240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 62/124] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:25 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:25.576732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.600865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ad0e-5cd7-4a51-973c-88804c81cbe9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.660209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.695376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.696134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.696484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.696826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.697562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:25.697878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.705453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221a23f-d644-4f29-8493-fcd13a5e074c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:25.735894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 63/125] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:25.735894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.736553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.736553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.743788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d921f-32e3-4b67-b2af-02c1d75593bd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:25.781385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:25.782611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:25.821970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:25.823010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:25.824252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:25.824736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:25.890376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 64/126] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:25.891790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:25.915832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:25.970129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:25.971986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.081804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:26.114966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525bf3-d84f-44ed-80a4-b22c98d1a9ec None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.231085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.233250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.233560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.233854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:26.238885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.240654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 65/127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:25 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:26.247350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.262557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 63/128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:26.263850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.352195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:26.373735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3cbc9-a7b7-451b-9ef4-fe1f0d086a4e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.419344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.420197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.420518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.420886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.432452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:26.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:26.441432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:26.442202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 66/129] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:26.442843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.502117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e08-3b24-4b84-a357-44212a62097c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.553884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da759-ade0-4a8a-a9d9-6322ac6cfc22 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.593866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.594747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.595040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.595325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.596626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:26.598112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.598616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.600323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.600480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 67/130] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:26.600960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.601181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.601276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.602821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:26.604350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.606091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 64/131] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:26.611025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.616358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:26.670349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:26.803732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f6b0-f8fc-4274-9b49-d96e1fff20ca None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.828411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88080-fbbc-4f91-b736-e15e94ce9789 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:26.855903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.856586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.856871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.857144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.857894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:26.858198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:26.859575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.869435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 68/132] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:26.870330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.902430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:26.903618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.904238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.904557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.905443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=d4ff93bae5fd48cb94c863943c00a1dc) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:26.905828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:26.908581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ed273-a0b8-4fcd-8745-6ef9f4a17ac4 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:26.917393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 65/133] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/role_assignments?user.id=d4ff93bae5fd48cb94c863943c00a1dc&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:26.918798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f8a61-f7fd-43c8-8007-f0b000bb8df9 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:26.919096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f8a61-f7fd-43c8-8007-f0b000bb8df9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:26.919679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f8a61-f7fd-43c8-8007-f0b000bb8df9 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:26.921010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 66/134] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:26.922508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f8a61-f7fd-43c8-8007-f0b000bb8df9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:26.980213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:27.034076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0f39-4a20-4a79-b696-b762590fbee2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.102496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:27.104281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.105197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.105535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.105825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/454ed721dbd84dcaa08428c7e40647f6/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.110189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, user_id=454ed721dbd84dcaa08428c7e40647f6, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:27.117399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:27.127293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f8a61-f7fd-43c8-8007-f0b000bb8df9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.168423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a1889-b928-4972-be75-8714b0974ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.169644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1889-b928-4972-be75-8714b0974ade None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.170100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1889-b928-4972-be75-8714b0974ade None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.170569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1889-b928-4972-be75-8714b0974ade None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.172066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a1889-b928-4972-be75-8714b0974ade None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:27.173806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a1889-b928-4972-be75-8714b0974ade None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:27.175632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 67/135] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:26 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:27.177079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.177625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.178259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.201570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:27.203159 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:27.222048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 69/136] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:26 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/454ed721dbd84dcaa08428c7e40647f6/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:27.222871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:27.285655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 68/137] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:27.321428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:27.372555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348f30-a63c-4877-ad65-d30ab95d2003 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.404795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:27.419620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.420872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.420979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.421179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] PATH_INFO: `/v3/projects/cb5145ecd857453e93341715206c683e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.424751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] RBAC: Authorizing `identity:get_project(project_id=cb5145ecd857453e93341715206c683e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:27.426383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:27.428572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 70/138] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:27 2022] GET /identity/v3/projects/cb5145ecd857453e93341715206c683e => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:27.434393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:27.443416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:27.461914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b1630-a479-4902-bcde-b7998ed8c474 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.502748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.503997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.504481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.504949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.517870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:27.527518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:27.528513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:27.529333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:27.532171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 69/139] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:27.541137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:27.640759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878a6c-7bb0-4d05-ba82-e6d09e14e417 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.699269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.700330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.700622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.701259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] PATH_INFO: `/v3/projects/cb5145ecd857453e93341715206c683e/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.703555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] RBAC: Authorizing `identity:create_grant(project_id=cb5145ecd857453e93341715206c683e, user_id=2827b6c15de64c1f9dea12ca5ccd48ca, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:27.705114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:27.773874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57db48-253c-488f-80a0-73cea74ee664 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:27.791568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 71/140] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:27 2022] PUT /identity/v3/projects/cb5145ecd857453e93341715206c683e/users/2827b6c15de64c1f9dea12ca5ccd48ca/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:33:27.846493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:27.847200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:27.847470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:27.847752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:27.848562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:27.848872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:27.851167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:27.863908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 70/141] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:27.870716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:27.976795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:28.026135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997678ed-ffdc-428f-8891-3dbb15942edd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:28.066279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:28.067191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.067481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.067761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.070160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:28.071684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:28.073467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 72/142] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:27 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:28.079495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:28.092728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:28.206374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7e9a1-876f-48e4-8d03-29a51072de12 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:28.246575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:28.247165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.247458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.247731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.330248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:28.331759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cb1b8-89eb-4f94-966a-3e306a252f44 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:28.344130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:28.444605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 71/143] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:28.448177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:28.450239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd0-7171-4df0-ac8e-53ee5e49ea43 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.450525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd0-7171-4df0-ac8e-53ee5e49ea43 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.450805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd0-7171-4df0-ac8e-53ee5e49ea43 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.452215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 72/144] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:28.464395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.464695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.464946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.483764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:28.485489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:28.568388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 73/145] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:28.598054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:28.662621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:28.723993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042611-a58e-45be-ad3c-c0af2a052b80 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:28.726786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27d5f-1938-4960-9fe8-11463578a555 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:28.762808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:28.769789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:28.775706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.775706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.775706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.775706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:28.776069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:28.776069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.776069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.776299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f5d3-398b-49ca-8bb8-9f17f2c3b7b8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:28.776379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.776797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 74/146] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:28.777349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:28.777843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1040be3-dd44-4b9e-aefa-b1eede325413 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.778131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1040be3-dd44-4b9e-aefa-b1eede325413 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.783393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1040be3-dd44-4b9e-aefa-b1eede325413 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.783393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 75/147] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:28.785558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:28.789138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:28.789429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:28.789714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:28.790236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 73/148] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:28 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:28.791221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:28.826755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:28.828382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:28.952585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c2cd-800c-4035-8482-778fb8afb04a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:28.973927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 76/149] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:28.976280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:29.016430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:29.017570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.018077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.018555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.019487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:29.022357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:29.054253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:29.119840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7268-8722-463c-bee0-363bb8061da9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:29.155140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 74/150] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:28 2022] POST /identity/v3/users => generated 283 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:29.156461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:29.160082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:29.160808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.161071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.161351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.162884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:29.163195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:29.165066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:29.173149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 77/151] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:28 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:29.274192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:29.361062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ada-d23e-4837-9f5f-87aae91b08eb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:29.413249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:29.413997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.414281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.414555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.428955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:29.437298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:29.438162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:29.438910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 75/152] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:29.445044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:29.575110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:29.580031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fd8d-9a89-4c17-9312-5c6ebcd6cf93 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:29.624707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:29.625408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.625690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.625970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.626757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:29.627067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:29.628596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:29.640741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 78/153] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:29.646883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:29.775336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d26dd-e1f5-4fce-bbe5-d9644723e3d1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:29.786760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:29.817102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:29.818584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.818875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.819152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.820517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:29.822004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380138bc-daee-45a4-a354-b9b85ed95799 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:29.827978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 76/154] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:29 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:29.830230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:29.930938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0f73-6649-4408-9205-d29688d66812 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.931249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0f73-6649-4408-9205-d29688d66812 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.931507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0f73-6649-4408-9205-d29688d66812 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.933324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 77/155] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:29.938689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:29.938969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:29.939257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:29.964157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:29.965363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463ce2-f99a-4ae3-8f20-6d6de983545d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:29.965491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:30.010539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.011911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.012386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.012891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.047875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 78/156] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:30.057113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:30.079360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.109123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:30.110857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:30.258550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75127d-97c9-462a-bb06-5487296d65b5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:30.279917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:30.299544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 79/157] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:30.301093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.318814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.320481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.320781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.321065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.342293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:30.357852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:30.358801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:30.359613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 79/158] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:30.367369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.392813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:30.439842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ac05-8a31-4fb7-bd6a-c697e07c2c18 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:30.489718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.491359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.491789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.492115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.493372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:30.494846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645d4ff-be26-4b80-b562-efa5fc71cdae None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:30.496941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 80/159] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:30.498214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e11b-bb16-4045-aaab-dcd98c961642 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.498496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e11b-bb16-4045-aaab-dcd98c961642 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.498769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e11b-bb16-4045-aaab-dcd98c961642 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.500142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 81/160] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:30.509677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.510042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.510324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.532190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd8ae-cbb0-4f4b-b75d-0085bd7a35fa None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:30.544016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:30.545228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:30.571694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.572413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.572703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.572985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.573754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:30.574593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:30.576027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:30.593790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 80/161] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:30.594499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.648094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:30.683185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 82/162] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:30.684270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.794173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:30.822539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080159-d36f-425a-893b-b8278555b6a7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:30.864551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6bc0e-6385-4b1f-86db-b47210e31f88 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:30.899774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.900806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.901281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.901769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.904073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:30.904591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:30.907300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:30.919898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 81/163] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:30.921980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:30.923358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:30.924533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:30.925927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:30.929266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] PATH_INFO: `/v3/users/d4ff93bae5fd48cb94c863943c00a1dc` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:30.931005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] RBAC: Authorizing `identity:get_user(user_id=d4ff93bae5fd48cb94c863943c00a1dc)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:30.932885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:30.936143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 83/164] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/users/d4ff93bae5fd48cb94c863943c00a1dc => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:30.942434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:31.154061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:31.170384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b75fe-8b7a-4929-a823-9cb169a9cf41 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:31.204334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbd14-9ba5-43e8-b060-77a3cdcccccd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:31.263020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:31.264235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.264719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.266093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.270863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:31.283314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:31.284377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.284707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.286109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.286207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:31.286284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:31.294395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:31.294395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 84/165] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:31.300857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:31.301739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:31.303266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:31.304428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:31.313245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 82/166] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:31.319743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:31.461422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4fe6-3c99-42ea-a05e-09a2325d32fb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:31.499857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:31.500393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54cd-8b2b-4077-9975-bdf6cf5dea81 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:31.501060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.501519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.502137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.503086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:31.503588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:31.505298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9515-5edb-46a5-97bd-9c575dc2d4c4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:31.517467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 83/167] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:31.519619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed282-135c-4049-805c-b00f7a8d0c34 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.520186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed282-135c-4049-805c-b00f7a8d0c34 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.520967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed282-135c-4049-805c-b00f7a8d0c34 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.523726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 84/168] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:31.530717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.531484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.532441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.558265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:31.561714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:31.581660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:31.582875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:31.583398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:31.584161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/d4ff93bae5fd48cb94c863943c00a1dc/roles/2b9e067f7bea48d2818bfa304de6347e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:31.586832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:31.588378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, user_id=d4ff93bae5fd48cb94c863943c00a1dc, role_id=2b9e067f7bea48d2818bfa304de6347e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:31.589872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:31.666467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 85/169] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:31.672576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:31.687420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 85/170] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:31 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/users/d4ff93bae5fd48cb94c863943c00a1dc/roles/2b9e067f7bea48d2818bfa304de6347e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:31.789449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:31.866433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd770-3fe3-467d-a178-2dca68e07ed0 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:31.890169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:31.970634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9f58-32df-4e3e-8632-cc4749015015 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.005266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.006693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.006979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.007252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] PATH_INFO: `/v3/users/454ed721dbd84dcaa08428c7e40647f6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.014097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] RBAC: Authorizing `identity:get_user(user_id=454ed721dbd84dcaa08428c7e40647f6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:32.015593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:32.017476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 86/171] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:31 2022] GET /identity/v3/users/454ed721dbd84dcaa08428c7e40647f6 => generated 247 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:32.023227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:32.026745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.027566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.027871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.028150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.042250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:32.051313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:32.052282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:32.053713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:32.054366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 86/172] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:32.060461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:32.061364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:32.234398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6275-73c7-4db8-bc69-534544cb8eff None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.278653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba2dfb-fafc-41df-ade2-4f751bfe93f0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.311353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.312040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.312142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:32.312326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.312606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.351223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.351935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.352218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.352500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.353268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:32.353574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:32.354984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:32.374936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 87/173] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:32.384855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:32.476813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:32.478289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:32.519996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:32.625317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346da8-5c2f-4a4f-82a8-cfa3c7656c70 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.702043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.703370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.704062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.704571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] PATH_INFO: `/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.709395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] RBAC: Authorizing `identity:get_user(user_id=2827b6c15de64c1f9dea12ca5ccd48ca)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:32.711038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:32.713201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 88/174] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:32 2022] GET /identity/v3/users/2827b6c15de64c1f9dea12ca5ccd48ca => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:32.718637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:32.720558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 87/175] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 14:33:32.726855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:32.836258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:32.919458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb9699-a978-49e1-9858-6b3a5961e6cc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.941516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d553f-8a89-410f-bc41-900bda68bb71 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:32.954110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:32.980561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:32.982467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.982770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.983050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.984330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:32.985790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bbfcd-c39d-451d-861e-b77ffe394697 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:32.988080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 88/176] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:32 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:32.989346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db0d-0d09-46e3-9b41-9ccb29128be5 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.989630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db0d-0d09-46e3-9b41-9ccb29128be5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.991849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db0d-0d09-46e3-9b41-9ccb29128be5 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:32.991849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 89/177] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:32.997553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:32.997845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:32.998124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.024392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:33.025057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.025340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.025620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.032961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:33.034167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:33.153069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 90/178] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:33.154372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.172432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:33.173951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:33.263760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:33.325359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172ee03-48fd-4cef-9f57-1e10cf7d465c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.348481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 89/179] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 14:33:33.351114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.355532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:33.405756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:33.406839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.407370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.409222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.410467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=454ed721dbd84dcaa08428c7e40647f6) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:33.413654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:33.415670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:33.431642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 91/180] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/role_assignments?user.id=454ed721dbd84dcaa08428c7e40647f6&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:33.432501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.513990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024ba4-67ba-4c7a-8248-fe632c0d1625 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.559329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfe5d1-c97f-4f92-b87c-de271ca25441 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.563634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:33.564477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.564759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.565040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.586538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0eec2cd0-a5e5-4f22-96e0-949fcffe2dd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:33.598554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:33.600235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:33.601241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:33.603780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 90/181] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:33.604706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:33.605634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef71a-b394-4d20-b958-b8a91787d22b None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.605790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.606194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.606403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef71a-b394-4d20-b958-b8a91787d22b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.606555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] PATH_INFO: `/v3/projects/cb5145ecd857453e93341715206c683e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.606985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef71a-b394-4d20-b958-b8a91787d22b None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.608083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] RBAC: Authorizing `identity:get_project(project_id=cb5145ecd857453e93341715206c683e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:33.608889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 91/182] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:33.610328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45d301-02fd-4876-ae52-077329be75d3 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.610833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45d301-02fd-4876-ae52-077329be75d3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.611313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45d301-02fd-4876-ae52-077329be75d3 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.613175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 92/183] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:33.613888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60281c3-0625-4fbd-ae4e-da93546d86bd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:33.614338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45d301-02fd-4876-ae52-077329be75d3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.616654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 92/184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/projects/cb5145ecd857453e93341715206c683e => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:33.620599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9b1c-2b21-42fc-b51c-b1f834aa4431 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.624253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9b1c-2b21-42fc-b51c-b1f834aa4431 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.624548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9b1c-2b21-42fc-b51c-b1f834aa4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.626984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:33.644874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ab5a9b1c-2b21-42fc-b51c-b1f834aa4431 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:33.646828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ab5a9b1c-2b21-42fc-b51c-b1f834aa4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:33.700108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:33.742356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 93/185] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:33.743496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.743798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.746686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.764776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:33.765981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:33.789985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45d301-02fd-4876-ae52-077329be75d3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.834938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:33.835611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:33.835925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:33.836198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:33.836995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:33.837248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:33.838638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:33.855631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 93/186] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:33.856616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.868432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 94/187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:33.869367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:33.936153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:33.973264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bcfb5-cd42-447b-9eaa-3b4e09bc15d2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.985871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887ff6-a650-438e-9efe-7b08365b63d7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:33.989280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.012373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.013039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.013327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.013607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.014477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=cb5145ecd857453e93341715206c683e, user.id=2827b6c15de64c1f9dea12ca5ccd48ca) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:34.014769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.016280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.023779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 94/188] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/role_assignments?user.id=2827b6c15de64c1f9dea12ca5ccd48ca&scope.project.id=cb5145ecd857453e93341715206c683e&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.024508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.037371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.038610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.039178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.039670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.057047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:34.069090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:34.070221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:34.071406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:34.077700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 95/189] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:34.077700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.171093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593858-1a5e-4ea6-938a-5949dbcaad3d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.206951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.212405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.213288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.213575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.213850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.222360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0c54-a05d-4770-8d23-39e2efd42888 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.232104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.233734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.237093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 95/190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.237349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.265550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.266710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.267067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.267408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.268776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.270249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.272047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 96/191] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.272890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.311682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.382092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cc15-874c-450c-94d0-7fffa98a6e5e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.401640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea84dc9-e908-45c0-9d14-308f8f64e608 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.418892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.419564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.419870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.420149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.420902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:34.421205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.422704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.432967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 96/192] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.437199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.440702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.441372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.441654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.441927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.503930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.523307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.524858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.554983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d994a-43c6-4d04-b50d-9aef88b08297 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.557905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.589105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.589778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.590059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.590335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.591063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.592579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bebf0-9b9e-4e13-b0b8-526ee62c4202 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.629469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 97/193] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:34.630367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 97/194] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:34 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f857db-35ba-469f-8807-2719dfdc1da8 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f857db-35ba-469f-8807-2719dfdc1da8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f857db-35ba-469f-8807-2719dfdc1da8 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 98/195] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:34.715844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f857db-35ba-469f-8807-2719dfdc1da8 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.742659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041711d0-5405-48cc-8dc4-00ca1499a46f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.778971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.784106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.785072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.785361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.785695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.787841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.789304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f2e2a-a10b-4818-aee2-e8925df084fc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.791151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 98/196] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.794556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.794556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.794556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.812085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:34.813323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:34.852649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f857db-35ba-469f-8807-2719dfdc1da8 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:34.863984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:34.896720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:34.897599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:34.898323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:34.898428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 99/197] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:34.898589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:34.898955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:34.900773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:34.904233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:34.911404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 99/198] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:34.912429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.040788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cf977-43ca-4721-94db-90a633f15f7f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.056595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc88f-c928-4a14-8b64-7ea44cb56173 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.080312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:35.088834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.090498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.090498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.090498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.106262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.107338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.107761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.108247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.109232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=3e9aec2f207440008cd7cb9496f3cc11) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:35.109683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.111276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.118992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 100/199] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/role_assignments?user.id=3e9aec2f207440008cd7cb9496f3cc11&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:35.120846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.168696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:35.171385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.173065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.238023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246e50-8a93-4677-b863-371cf2d0a256 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.278715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.279953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.280463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.280931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.293712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:35.293899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 100/200] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:35.299948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:35.303332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:35.304289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:35.305059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:35.307580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 101/201] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:35.321194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.333483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:35.431365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e75b9-d06c-4cff-8f49-dea50da8b295 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.472799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:35.475427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805158b2-ad5e-4535-a897-3e72cdb86e79 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.514633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.515516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.515799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.516100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.518400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.522115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.527555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 101/202] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:35.530781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.534549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.535231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.535510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.535790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.536581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:35.537095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.538655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.561035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 102/203] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:35.567112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.691791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:35.696960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168437c-2a6b-466a-aab3-0fd0cd9e3ce2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.757840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.758507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.758788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.759060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.759924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=3e9aec2f207440008cd7cb9496f3cc11) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:35.760259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.761738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.773774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/role_assignments?user.id=3e9aec2f207440008cd7cb9496f3cc11&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:35.786021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650319-96d3-4eb4-9b93-1cb57bfbbd36 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:35.837719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:35.838992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:35.839509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:35.840022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] PATH_INFO: `/v3/users/d4ff93bae5fd48cb94c863943c00a1dc` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:35.844817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ff93bae5fd48cb94c863943c00a1dc)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:35.846756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:35.848884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/users/d4ff93bae5fd48cb94c863943c00a1dc => generated 289 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:35.855008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:35.999004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7358-43da-42c7-9861-844b99b78707 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:36.037614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:36.038336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:36.038615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:36.038931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:36.082512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:36.123799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:36.125325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:36.255907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:36.261635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:36.306144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:36.382526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735602-07d8-468c-8ed1-183c74b1b465 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:36.418429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:36.419303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:36.419588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:36.419895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:36.421153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:36.422627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c65c1-ca57-425b-864e-2c2561fa3b09 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:36.424742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:36 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:36.431604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:36.533060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:36.589154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542066-7b81-405c-91fb-f56e1e3ae160 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:36.637899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:36.638895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:36.639402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:36.639910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:36.640943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73, user.id=d4ff93bae5fd48cb94c863943c00a1dc) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:36.641445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:36.643079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa4ad9-5160-43b7-83e4-8611507e32fe None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:36.652788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:36 2022] GET /identity/v3/role_assignments?user.id=d4ff93bae5fd48cb94c863943c00a1dc&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:37.472454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19922-3237-490c-8cea-ad6d3e1de914 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.473468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19922-3237-490c-8cea-ad6d3e1de914 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.473979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19922-3237-490c-8cea-ad6d3e1de914 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.476632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:37.482285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21e2f-4f04-4f02-86e3-831253ca5e00 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.483145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21e2f-4f04-4f02-86e3-831253ca5e00 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.483618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21e2f-4f04-4f02-86e3-831253ca5e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.501487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a2b21e2f-4f04-4f02-86e3-831253ca5e00 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:37.503006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a2b21e2f-4f04-4f02-86e3-831253ca5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:37.575979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:37.596653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19922-3237-490c-8cea-ad6d3e1de914 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:37.667131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2ca9-ea04-4cb0-abf6-d2221e96c9d4 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.667746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2ca9-ea04-4cb0-abf6-d2221e96c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.668278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2ca9-ea04-4cb0-abf6-d2221e96c9d4 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.669968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:37.671605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f30ce-8c64-4479-b5a6-0912461755f4 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.672127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f30ce-8c64-4479-b5a6-0912461755f4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.672593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f30ce-8c64-4479-b5a6-0912461755f4 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.674394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 107/212] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:37.675722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7276a48-0d16-43f9-ae24-8882631d25b5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.676480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7276a48-0d16-43f9-ae24-8882631d25b5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.676955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7276a48-0d16-43f9-ae24-8882631d25b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.695141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e7276a48-0d16-43f9-ae24-8882631d25b5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:37.696359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e7276a48-0d16-43f9-ae24-8882631d25b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:37.713650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:37.719159 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19922-3237-490c-8cea-ad6d3e1de914 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:37.757802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:37.764132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:37.764991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.765271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.765542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.775645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 108/213] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:37.777049 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.777343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.777625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.777800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:37.788049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:37.789301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:37.790260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 106/214] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:37.798019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:37.805150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:37.806377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:37.891870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 109/215] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:37.892678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:37.920518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2bb36-2f2c-49de-9e14-7c0e8907938a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:37.961551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:37.962220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:37.962670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:37.962875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:37.964029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:37.964151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:37.965469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:37.974816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 107/216] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:37.979349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.004443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.004768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ead42f-5286-4b54-be91-1372e0d5443d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.023111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.043898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.044714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.045002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.045280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.058306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:38.067148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:38.068176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:38.069153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 110/217] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:38.069926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.097324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7dffc-27d0-4562-bd03-33ea48ab2cef None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.160074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.161149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.161618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.162510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.163845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.165437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.171417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 108/218] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:38.171417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.217355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088d8d2-55ca-4e9f-bb06-f51d29438d8b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.261400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.262220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.262507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.262787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] PATH_INFO: `/v3/users/5035a235ee3e403eb2aef07a520d6303` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.273325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.280610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] RBAC: Authorizing `identity:get_user(user_id=5035a235ee3e403eb2aef07a520d6303)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.289171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.289171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 111/219] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/users/5035a235ee3e403eb2aef07a520d6303 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:38.289171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.294555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450dee5-92ba-40b3-a7e0-012ea991cc42 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.331333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.350918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.351601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.351915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.352190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.352952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:38.353255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.354644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.363226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 109/220] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:38.364110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.410206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee15c4-8c4a-4b7f-8ed8-1fb7aa49d241 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.446430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.447353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.447637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.448000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.448718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.450417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c27027-89b0-4fef-b099-a97aadd5f63d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.475583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21ac77-38f1-451c-910b-82e541bf9351 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.510371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.511018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.511300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.511622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.530572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.576441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 112/221] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:38 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:38.577761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2000-9a9e-4ffc-9b0c-4bd99efb6c02 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.578051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2000-9a9e-4ffc-9b0c-4bd99efb6c02 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.578382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2000-9a9e-4ffc-9b0c-4bd99efb6c02 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.579919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 113/222] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:38.580490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff2000-9a9e-4ffc-9b0c-4bd99efb6c02 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.587364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.588965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda63a0-37a6-4fce-accb-a9d79303001b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.700080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.715025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 110/223] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:38.715025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.715025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.715025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.720471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff2000-9a9e-4ffc-9b0c-4bd99efb6c02 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.730547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:38.731755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:38.766419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.767268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.767553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.767847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.769104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.770560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.773224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 114/224] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:38.773933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.793835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:38.822207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 111/225] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:38.825284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.909552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6900-b143-499a-82ba-d34e8ecae1ed None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.957605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:38.958493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:38.959531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:38.959831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:38.961382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:38.962899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:38.964998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d108-5e66-4182-9b33-a8f091dcbdce None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:38.965120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 115/226] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:38.965973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:38.997676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:39.006231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.009281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.009281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.009281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.009496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.010884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.012857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 112/227] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:39.013747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.091135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:39.109749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1ba9-658e-45de-96a6-4675e3f209b8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.162534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.163650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.163982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.164262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.169486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0850-bb61-4384-9a09-46d8ce3d133b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.178877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:39.190384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:39.191496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 116/228] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:39.192425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.217941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.219086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.219506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.220263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.221250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=5035a235ee3e403eb2aef07a520d6303) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:39.221704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.223925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.238117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 113/229] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:39 2022] GET /identity/v3/role_assignments?user.id=5035a235ee3e403eb2aef07a520d6303&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:39.238117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.386554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:39.421495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c1dc-544b-4965-92c9-5f35d176c446 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.453144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bde6-b0a3-433d-adde-e750e1cee37b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.467707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.469361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:39.469969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.470690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.471404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/3e9aec2f207440008cd7cb9496f3cc11/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.475155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, user_id=3e9aec2f207440008cd7cb9496f3cc11, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.477256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.495504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.496219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.496501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.496778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.497709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:39.498024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.499595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.515260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 114/230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:39.516594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.577250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 117/231] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:39 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/3e9aec2f207440008cd7cb9496f3cc11/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:39.635704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62823-ddd0-455e-b9dc-9ddc439bdd09 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.675786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.676646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.676932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.677210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.679238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.680816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.687258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 115/232] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:39 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:39.688803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.855430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8b70c-ce25-4f8c-bee4-1916a07315d9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:39.892207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:39.893095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:39.893381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:39.893658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:39.894896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:39.896437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273241f-bfec-4259-85af-1b9429049e69 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:39.902742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 118/233] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:39 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:39.904501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:39.956429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:40.020426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60564-1ea5-459b-a44f-ed946473fdc0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:40.059968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:40.060916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:40.061198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:40.061480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/3e9aec2f207440008cd7cb9496f3cc11/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:40.063884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, user_id=3e9aec2f207440008cd7cb9496f3cc11, role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:40.065379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc22c4-0470-4b69-967b-73ee22c89fec None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:40.138277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 116/234] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:39 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/3e9aec2f207440008cd7cb9496f3cc11/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:41.072532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f2cf-711c-4f98-9b64-6ff4b4c68300 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.073510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f2cf-711c-4f98-9b64-6ff4b4c68300 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.073990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f2cf-711c-4f98-9b64-6ff4b4c68300 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.076096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 119/235] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:41.081918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932005-3191-4e9a-b6aa-f21f8b5afd6d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.082401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932005-3191-4e9a-b6aa-f21f8b5afd6d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.082474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932005-3191-4e9a-b6aa-f21f8b5afd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.107393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b1932005-3191-4e9a-b6aa-f21f8b5afd6d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:41.108647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b1932005-3191-4e9a-b6aa-f21f8b5afd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:41.211410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 117/236] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:41.234152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47f2cf-711c-4f98-9b64-6ff4b4c68300 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:41.269281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:41.405398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58336-8615-48c5-a7a2-ba08adfbcc79 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.405978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58336-8615-48c5-a7a2-ba08adfbcc79 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.406423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58336-8615-48c5-a7a2-ba08adfbcc79 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.407149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47f2cf-711c-4f98-9b64-6ff4b4c68300 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:41.408244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 118/237] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:41.413879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.414412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.414877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.447467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:41.450282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:41.477131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:41.478430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.478938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.479479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.501759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:41.510313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:41.511241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:41.512087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:41.520263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:41.520558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 120/238] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:41.527627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:41.592979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 119/239] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:41.652518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:41.655557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:41.706724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8761e-7070-4143-8b44-1455b1488642 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:41.769753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:41.770427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.770708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.770979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.771778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:41.772107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:41.773490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d20e-3f55-496b-a770-3e531825c374 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:41.796280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 121/240] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:41.803470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b4d5-bf50-4e81-bf7e-bd12af4a1ce3 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.803749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b4d5-bf50-4e81-bf7e-bd12af4a1ce3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.804093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b4d5-bf50-4e81-bf7e-bd12af4a1ce3 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.805773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 122/241] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:41.806648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b4d5-bf50-4e81-bf7e-bd12af4a1ce3 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:41.862861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b3bf-e578-4720-9019-2624b15f287d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:41.907449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:41.908701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.909169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.909630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.911153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:41.913374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9840bd-65be-4e9d-a87e-1734bc5ad61a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:41.915236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 120/242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:41.916504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.916795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.917072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.935281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:41.936544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:41.940348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b4d5-bf50-4e81-bf7e-bd12af4a1ce3 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:41.963611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:41.979133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:41.980114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:41.980403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:41.980721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] PATH_INFO: `/v3/users/91576bc3a039420ba73139024488f2ab` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:41.984155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.000045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] RBAC: Authorizing `identity:get_user(user_id=91576bc3a039420ba73139024488f2ab)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:42.001602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:42.004663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 123/243] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:41 2022] GET /identity/v3/users/91576bc3a039420ba73139024488f2ab => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:42.005939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.019490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 121/244] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:42.020799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.150140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b14a1-2446-4c10-9c36-7ea96615e860 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.156486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91134-ab23-40cc-98cb-9d6871837fae None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.194706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.195844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.196251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.196620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.196908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.197182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.197452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.197752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.198846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:42.201597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:42.231695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.273917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:42.275394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598362e-2135-46f4-b6ad-8d4b0da44a70 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:42.308234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 124/245] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:42 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:42.310167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.414091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.473564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3dcc-8b33-47f4-ab7f-cafd6d43f474 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.496351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 122/246] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:42.497554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658a07-0003-4b06-8e5c-01bb8424b33c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.497838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658a07-0003-4b06-8e5c-01bb8424b33c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.498220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658a07-0003-4b06-8e5c-01bb8424b33c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.499598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 123/247] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:42.504475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658a07-0003-4b06-8e5c-01bb8424b33c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.519147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.520039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.520327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.520601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.532598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-7dc99b1c-47c0-491b-8522-bbc749407967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:42.541164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:42.542098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:42.542956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 125/248] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:42.543624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.544210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.544210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.562337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:42.563565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:42.586930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.645592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658a07-0003-4b06-8e5c-01bb8424b33c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.653193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 126/249] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:42.654154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.702674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.703544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.707984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.707984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.708177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.708386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:42.712893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:42.714553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 124/250] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:42.715187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.807740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215d12-12a3-4663-b0a8-ebffd07e2b03 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.859467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.860264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.861203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.861491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.862265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:42.862574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:42.864355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:42.877803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 127/251] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:42.878205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:42.884142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29801-3b3f-4361-979e-a09c97ceec47 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:42.924242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:42.936336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:42.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:42.938006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:42.938553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:42.959466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:42.967575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:42.968619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:42.969422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 125/252] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:42.970070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.034547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632fff-e0bc-426c-9fc9-05cff8d910dc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.041097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:43.100869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7d5d2-3e81-49ab-83f2-a9a969235ac1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.115995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.116725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.117018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.117296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.118157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=91576bc3a039420ba73139024488f2ab) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:43.118501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.119983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.133117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 128/253] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/role_assignments?user.id=91576bc3a039420ba73139024488f2ab&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:43.135056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.142749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.143654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.143970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.144251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] PATH_INFO: `/v3/users/5035a235ee3e403eb2aef07a520d6303` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.145496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] RBAC: Authorizing `identity:get_user(user_id=5035a235ee3e403eb2aef07a520d6303)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.147210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.149257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 126/254] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:42 2022] GET /identity/v3/users/5035a235ee3e403eb2aef07a520d6303 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:43.161317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.233804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:43.281731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b8f4-8a28-4897-bd1b-a8e6fcdaddd3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.356372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.357269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.357549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.357825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.359502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.361631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb921f-06c4-485e-ba90-9f8fbb076815 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.363831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 127/255] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:43 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:43.367200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94406-66d0-48d4-ba24-bd0ea163ec5d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.367200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94406-66d0-48d4-ba24-bd0ea163ec5d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.367200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94406-66d0-48d4-ba24-bd0ea163ec5d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.368731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 128/256] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:43.374730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.375008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.375265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.403517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202e98-7121-440c-80e4-48789884aaf7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.409954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:43.413736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:43.465902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.466647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.466932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.467210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.471868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:43.471868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.471868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.489210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 129/257] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:43.493733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.560812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:43.561434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 129/258] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:43.562712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.687935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:43.737864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5d20d-bebc-45ec-ac58-7d566260ac46 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.768248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf9d0-add4-4f4e-8370-11bc2e7234a5 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:43.824842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.826050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.826511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.826958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.828381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.830058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.832210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 130/259] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:43 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:43.833136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.840581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3557f-798e-41da-8300-18eed97162de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:43.841492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3557f-798e-41da-8300-18eed97162de None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:43.841777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3557f-798e-41da-8300-18eed97162de None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:43.842054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3557f-798e-41da-8300-18eed97162de None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/5035a235ee3e403eb2aef07a520d6303/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:43.848757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3557f-798e-41da-8300-18eed97162de None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, user_id=5035a235ee3e403eb2aef07a520d6303, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:43.851302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3557f-798e-41da-8300-18eed97162de None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:43.954613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 130/260] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:43 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/5035a235ee3e403eb2aef07a520d6303/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:43.955162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3557f-798e-41da-8300-18eed97162de None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:43.969810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3978a-586b-4cfe-a1ce-6f102c4409d1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:44.007028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:44.021330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:44.022220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:44.022495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:44.022816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:44.041181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:44.054273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:44.055222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:44.056029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:44.056628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 131/261] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:44.061738 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:44.207737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:44.238991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3557f-798e-41da-8300-18eed97162de None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:44.249788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855cea-ea09-486f-b35f-ff1e42725c72 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:44.295169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:44.296000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:44.296351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:44.296674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:44.297577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:44.297951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:44.300653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:44.319746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 132/262] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:44.326356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:44.331742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:44.332537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:44.332942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:44.333289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:44.446780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:44.496735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:44.498110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:44.550219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c940-db98-48cf-9056-5aa8517bf9ea None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:44.613123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:44.613992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:44.614283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:44.614561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] PATH_INFO: `/v3/users/3e9aec2f207440008cd7cb9496f3cc11` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:44.616186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9aec2f207440008cd7cb9496f3cc11)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:44.617936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:44.620775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 133/263] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:44 2022] GET /identity/v3/users/3e9aec2f207440008cd7cb9496f3cc11 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:44.626651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:44.712247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:44.723739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 131/264] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:44.742058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:44.826028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe869ae5-5cbb-400b-a727-d97c26b3c384 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:44.856855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:44.887119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:44.887931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:44.888285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:44.888637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:44.945786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a334a38-fe9f-4fa1-b32c-f5d1ecbcef90 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.013863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.015539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.016038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.016496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.018362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.025867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.028355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 132/265] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:44 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:45.037508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.059254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.061043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100033-b7a1-45f6-9d4b-70446c2d7555 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.124660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.178473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b973a6-81e5-4371-8aff-e23e5cd08492 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.216313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.217318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.217318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.217797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.218710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=3e9aec2f207440008cd7cb9496f3cc11) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:45.219091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.220719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4a5a0-94f6-484b-9b30-3e8e1dd8b62e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.232365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 134/266] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:45.234091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca91-0070-4250-ba60-fda9558d051b None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.234647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca91-0070-4250-ba60-fda9558d051b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.235146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca91-0070-4250-ba60-fda9558d051b None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.235376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 133/267] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/role_assignments?user.id=3e9aec2f207440008cd7cb9496f3cc11&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:45.236921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 135/268] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:45.251591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ca91-0070-4250-ba60-fda9558d051b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.252233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.252460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.252711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.278671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.296996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:45.298225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:45.387473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ca91-0070-4250-ba60-fda9558d051b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.430124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.431294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.431754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.432300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.433829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.435512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.437856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 136/269] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:45.445062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.478718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:45.525866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.540558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.564954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0e73-865f-4726-bcaa-45856d83b6be None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.602540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.605393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.606063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.606350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.606625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.607477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=3e9aec2f207440008cd7cb9496f3cc11) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:45.607787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.609278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234dd9-4d91-42cc-ad3f-5f2fc3210ef6 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.616694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 137/271] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/role_assignments?user.id=3e9aec2f207440008cd7cb9496f3cc11&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:45.628628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2b9-f130-4ae0-9a45-7a00d109d3d2 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.628918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2b9-f130-4ae0-9a45-7a00d109d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.629205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2b9-f130-4ae0-9a45-7a00d109d3d2 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.631046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 138/272] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:45.642015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.642298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.642490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.659016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf617a0-e3e9-4307-8a03-6af047e93699 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.673604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:45.674858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:45.698663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.699836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.700151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.700455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.728560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:45.744398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:45.745379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:45.746167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:45.753681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 135/273] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:45.753836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.832973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 139/274] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:45.861974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:45.918454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4de5-169c-40b0-97b2-8c35eccaa0bb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:45.933824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.963936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:45.970252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:45.970932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:45.971403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:45.971993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:45.972854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:45.973226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:45.974911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:45.988249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 136/275] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:46.000714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9695e6-bb47-4f98-8a6b-61733d3a98aa None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.002036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.064344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.065151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.065428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.065703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.066898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:46.069549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:46.071982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 140/276] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:46.078136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.152666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63dd23-2d42-4831-a32a-6909b05dff96 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.190437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.191105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670aa5-7c48-44e9-aa39-20db27b12f22 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.191212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.191569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.191917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] PATH_INFO: `/v3/users/8a3ecae4b1db4689940c550276ee97fd` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.208292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ecae4b1db4689940c550276ee97fd)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:46.209966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f58de9-ec6e-44cb-a162-9cdcc426fbab None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:46.216355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 137/277] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:46 2022] GET /identity/v3/users/8a3ecae4b1db4689940c550276ee97fd => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:46.216355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606156e6-1cf4-4084-82c2-39b478c03500 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.216355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606156e6-1cf4-4084-82c2-39b478c03500 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.216355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606156e6-1cf4-4084-82c2-39b478c03500 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.216355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 138/278] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:46.219527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606156e6-1cf4-4084-82c2-39b478c03500 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.241286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.242396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.242705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.242966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.243873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:46.245341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ad3f7-2ffd-422f-9e5b-cb634d8133db None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:46.250644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:46.322440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606156e6-1cf4-4084-82c2-39b478c03500 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.337596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:46.344111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 141/279] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:33:46 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:46.345390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.345732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.346066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.365822 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.366954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.367496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.368048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.369310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, user.id=8a3ecae4b1db4689940c550276ee97fd, scope.system=all) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:46.369871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:46.371829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:46.372348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:46.373710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:46.379926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 139/280] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jun 15 14:33:46 2022] GET /identity/v3/role_assignments?user.id=8a3ecae4b1db4689940c550276ee97fd&scope.system=all&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:46.479191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 142/281] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:46.503841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.616996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:46.624496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4610ac-70f6-463e-b24c-189e56175ade None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.661018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.661886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.662687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.662963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.674104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:46.682085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:46.683005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:46.684144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 140/282] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:46.689610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.812905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a505d-e920-42d4-89c0-dbf043c6b4df None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:46.850193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:46.864456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:46.872218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:46.879376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 143/283] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:46.885546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:46.998695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d5c8-8e37-45af-973c-b0b4d1e337de None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.039252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.040195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.040480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.040765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] PATH_INFO: `/v3/users/91576bc3a039420ba73139024488f2ab` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.042630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] RBAC: Authorizing `identity:get_user(user_id=91576bc3a039420ba73139024488f2ab)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:47.044715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d166-e058-464a-8637-d4e8bd0a6f14 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:47.046933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 141/284] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:46 2022] GET /identity/v3/users/91576bc3a039420ba73139024488f2ab => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:47.052141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:47.117012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8e2f-7030-4855-918e-f6de7a67deb8 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.117458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8e2f-7030-4855-918e-f6de7a67deb8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.118594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8e2f-7030-4855-918e-f6de7a67deb8 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.119689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 142/285] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:47.125149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.125557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.125902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.161776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:47.163185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:47.188670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:47.217417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179de56-3b99-4f4a-84f2-9f0d6bb198d5 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.264789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.265567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.265881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.266131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.267341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:47.268832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:47.270923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 144/286] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:47 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:47.277239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:47.285161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 143/287] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:47.337315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:47.348498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:47.389243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80c26-b248-4080-b5dd-b68b54bcca99 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.429466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.430367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.430647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.430920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/91576bc3a039420ba73139024488f2ab/roles/2b9e067f7bea48d2818bfa304de6347e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.433785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, user_id=91576bc3a039420ba73139024488f2ab, role_id=2b9e067f7bea48d2818bfa304de6347e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:47.435277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:47.498257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd11163-2b3e-4376-bf3f-a7d2f8b68041 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.525681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 145/288] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:33:47 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/users/91576bc3a039420ba73139024488f2ab/roles/2b9e067f7bea48d2818bfa304de6347e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:33:47.544953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.545814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.546094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.546365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.560735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:47.569574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:47.570520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:47.571293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 144/289] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:47.577283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:47.720014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b7ef5-aa0e-4dc1-a2ea-7f032d6b2808 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.753311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:47.776728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.777343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.777628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.777907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.778681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:47.778991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:47.780425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:47.796296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 146/290] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:47.801975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:47.821806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:47.914783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f5986-b646-42b6-99ea-a3d5f6395366 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:47.957556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:47.958432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:47.959433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:47.959635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] PATH_INFO: `/v3/users/5035a235ee3e403eb2aef07a520d6303` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:47.964574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] RBAC: Authorizing `identity:get_user(user_id=5035a235ee3e403eb2aef07a520d6303)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:47.966040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:47.967718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 145/291] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:47 2022] GET /identity/v3/users/5035a235ee3e403eb2aef07a520d6303 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:47.973093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:48.117729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bf52-be6f-4bd8-9e09-48ab0899159b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:48.168573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:48.169248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:48.169538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:48.169821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:48.235275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:48.264936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:48.266420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:48.400464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 147/292] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:48.408865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:48.524178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:48.547516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc99bc-407c-415f-a984-61777f2bad31 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:48.587009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:48.587899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:48.588186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:48.588463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:48.589673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:48.591130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527453f-a9b4-4982-9073-217feb299836 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:48.593255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 146/293] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:48 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:48.601451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:48.722599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:48.749543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3eb87-94c9-42cc-a71c-0bfa4fa16ab1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:48.801277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:48.802321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:48.802832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:48.803462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:48.804518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=5035a235ee3e403eb2aef07a520d6303) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:48.805024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:48.806671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0307-44aa-4ad2-adf1-f87f099d22d5 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:48.817037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 148/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:48 2022] GET /identity/v3/role_assignments?user.id=5035a235ee3e403eb2aef07a520d6303&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:48.887659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f342-8e1b-4aab-abe6-a8d62a723eeb None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:48.888201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f342-8e1b-4aab-abe6-a8d62a723eeb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:48.888273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f342-8e1b-4aab-abe6-a8d62a723eeb None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:48.890042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 147/295] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:48.895768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0393b6-5b3c-4286-9c18-db0dc4605090 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:48.896396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0393b6-5b3c-4286-9c18-db0dc4605090 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:48.896868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0393b6-5b3c-4286-9c18-db0dc4605090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:48.925064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ef0393b6-5b3c-4286-9c18-db0dc4605090 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:48.926690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ef0393b6-5b3c-4286-9c18-db0dc4605090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:49.021169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 149/296] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:49.045788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f342-8e1b-4aab-abe6-a8d62a723eeb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.190230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f342-8e1b-4aab-abe6-a8d62a723eeb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.230521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b43f3-618c-48a9-8cc6-22c40a9a1961 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.231161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b43f3-618c-48a9-8cc6-22c40a9a1961 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.231430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.231869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b43f3-618c-48a9-8cc6-22c40a9a1961 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.232274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.232556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.232830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.234332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 150/297] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:49.245689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.245984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.246250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.248036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:49.256970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:49.257870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:49.258660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:49.265324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 148/298] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:49.266513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.277619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:49.278833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:49.279681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.360350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 151/299] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:49.384460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.387846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.390656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5142931-3572-45e0-bcde-6d6fbd642acd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.434516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.435558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.435870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.436154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.437199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:49.437512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:49.439053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:49.454432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 149/300] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:49.456057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.503954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a959-d7b1-4692-a543-ba6f95cffe4f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.547673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.548827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.549304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.549765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.562202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:49.572197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:49.572650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:49.573522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:49.574306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:49.581641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 152/301] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:49.582898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.595226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c15f7-4a9e-44f5-812a-c258573c04a3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.638140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.639428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.640136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.640826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] PATH_INFO: `/v3/users/8a3ecae4b1db4689940c550276ee97fd` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.642726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ecae4b1db4689940c550276ee97fd)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:49.644421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:49.651574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 150/302] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/users/8a3ecae4b1db4689940c550276ee97fd => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:49.652654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.665067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.707105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dcc7-f12b-4260-9648-b1cc60d2700d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.758338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.759007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.759281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.759554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.760379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:49.760641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:49.762033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13327aed-72aa-480d-93d6-2f2526d6224c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:49.765030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d09a83-0798-4515-b208-aadaebbb1c03 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.772078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 153/303] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:49.773745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951554-a9cd-4c2c-9742-92ecc7f44167 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.774109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951554-a9cd-4c2c-9742-92ecc7f44167 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.774462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951554-a9cd-4c2c-9742-92ecc7f44167 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.775829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 154/304] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:49.780743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951554-a9cd-4c2c-9742-92ecc7f44167 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:49.809175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.809959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.810246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.810520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] PATH_INFO: `/v3/system/users/8a3ecae4b1db4689940c550276ee97fd/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.812202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a3ecae4b1db4689940c550276ee97fd, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:49.813577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145a2e-5782-410d-9047-af61db322ebf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:49.885879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951554-a9cd-4c2c-9742-92ecc7f44167 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:49.900165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 151/305] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jun 15 14:33:49 2022] PUT /identity/v3/system/users/8a3ecae4b1db4689940c550276ee97fd/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:49.900165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.900165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.900165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.904665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.919481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:49.921054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:49.928958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:49.941391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:49.942591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:49.942879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:49.943251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] PATH_INFO: `/v3/users/09d6cb736d994f2883abea5f544ecb45` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:49.965183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] RBAC: Authorizing `identity:get_user(user_id=09d6cb736d994f2883abea5f544ecb45)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:49.966784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:49.976259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 155/306] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/users/09d6cb736d994f2883abea5f544ecb45 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:49.977248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.028184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 152/307] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:50.045775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.122051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76051f7-69b2-4013-84ec-9f89cace80fa None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.172059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.172744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.173026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.173301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.174169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, user.id=09d6cb736d994f2883abea5f544ecb45, scope.system=all) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:50.174485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:50.176277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8ca37-6805-4f2b-8971-5bc269aac0d2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:50.183703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 156/308] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jun 15 14:33:49 2022] GET /identity/v3/role_assignments?user.id=09d6cb736d994f2883abea5f544ecb45&scope.system=all&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:50.211310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20495-c55a-40c1-8fea-f7f70406cc4b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.251002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee5a-a76a-4fb2-a9c1-a01892b67212 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.251275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:50.251407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee5a-a76a-4fb2-a9c1-a01892b67212 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.251653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee5a-a76a-4fb2-a9c1-a01892b67212 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.253380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 157/309] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:50.259437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.259941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.260234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.260397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.260516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.266050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.266050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.266050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:50.266050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:50.266050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 153/310] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:50.277151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.288127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:50.290476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:50.351778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:50.382892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 158/311] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:50.406973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.409211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9ec2-fd3b-4fe2-882d-59f69caef2a6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.453845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.454543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.454827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.455124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] PATH_INFO: `/v3/groups` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.455827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:50.457295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:50.516091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a36ad-88ec-434a-84e4-8adbc1017173 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.555708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.559829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 154/312] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Jun 15 14:33:50 2022] POST /identity/v3/groups => generated 229 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:33:50.562475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.562475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.562475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.576637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:50.585541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:50.586521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:50.587342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 159/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:50.593447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.691231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:50.757886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17668c23-d15b-4a0d-907d-81d6e673473b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.798268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.799288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.799761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.800075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.800842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:50.801150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:50.803141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:50.813523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 155/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:50.819747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:50.869675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:50.941065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3b16-ee68-4c80-98d0-7e4c614c0421 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:50.979438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:50.980278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:50.980553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:50.980822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] PATH_INFO: `/v3/users/91576bc3a039420ba73139024488f2ab` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:50.982116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] RBAC: Authorizing `identity:get_user(user_id=91576bc3a039420ba73139024488f2ab)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:50.983645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:50.985632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 160/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:50 2022] GET /identity/v3/users/91576bc3a039420ba73139024488f2ab => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:50.992926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:51.101228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559173b-14e1-4386-85f1-96bb4db95581 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:51.128564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:51.141712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:51.142510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:51.142795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:51.143073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:51.219546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:51.221035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:51.336270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 156/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:51.341975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:51.449891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295f9e-a18e-4996-b714-4ac49f14cac1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:51.457314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:51.486668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:51.487532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:51.487831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:51.488120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:51.489357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:51.490890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864571c1-5dfb-4086-a3c7-650561cd3c82 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:51.492941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 161/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:51 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:51.498891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:51.526473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:51.608899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27819-03e0-4818-a132-14be4127fca3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:51.644722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:51.645378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:51.645663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:51.645941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:51.647407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8, user.id=91576bc3a039420ba73139024488f2ab) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:51.647721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:51.649263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0b5-c714-4f70-9708-d18c8f57b551 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:51.655600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 157/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:33:51 2022] GET /identity/v3/role_assignments?user.id=91576bc3a039420ba73139024488f2ab&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:52.271177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbdb1d-81eb-4b7f-8b8b-7e86129465f3 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.272032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbdb1d-81eb-4b7f-8b8b-7e86129465f3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.272242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbdb1d-81eb-4b7f-8b8b-7e86129465f3 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.273663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 162/319] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:52.278728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb13-5840-499f-b958-874688a3a76d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.279105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb13-5840-499f-b958-874688a3a76d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.279276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb13-5840-499f-b958-874688a3a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.296874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-12e3fb13-5840-499f-b958-874688a3a76d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:52.298085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-12e3fb13-5840-499f-b958-874688a3a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:52.374336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 158/320] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:52.382612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cb8bd-ccfc-4f40-ace0-1038f1988a25 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.382963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cb8bd-ccfc-4f40-ace0-1038f1988a25 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.383306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cb8bd-ccfc-4f40-ace0-1038f1988a25 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.384907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 163/321] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:52.390073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.390363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.390637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.398798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cb8bd-ccfc-4f40-ace0-1038f1988a25 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.408216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:52.409422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:52.421807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:52.485600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 159/322] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:52.508484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.513540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cb8bd-ccfc-4f40-ace0-1038f1988a25 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:52.549320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:52.550033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.550311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.550583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.562000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:52.570014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:52.571161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:52.572466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 164/323] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:52.576997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.614983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:52.620911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c47a-1808-4c46-a834-0d72124446b7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:52.654724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:52.655513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.655798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.656100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.666877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:52.674588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:52.675466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:52.676266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 160/324] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:52.681923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.686409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274027-63c7-477e-8f1d-4dfd4bbfc5f3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:52.724244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:52.725480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.725760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.726029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.729437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:52.729437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:52.729437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:52.744659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 165/325] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:52.745897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:52.750102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.793132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617edfa9-3520-46d2-a98a-ef8953158b92 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:52.837185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:52.838148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.838494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.838781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.840426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:52.840755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:52.842473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:52.854052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:52.855777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 161/326] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:52.861382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.866461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838544-dd2b-4f9f-bc7a-9db4ebb45a79 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:52.900727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:52.901606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.901882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.902152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] PATH_INFO: `/v3/users/8a3ecae4b1db4689940c550276ee97fd` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.903334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ecae4b1db4689940c550276ee97fd)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:52.904784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c48c1c-af96-4737-b83e-3e4c092c3a21 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:52.906417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 166/327] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/users/8a3ecae4b1db4689940c550276ee97fd => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:52.907566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2923-7ca4-4783-8cde-a78d8081184a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:52.907864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2923-7ca4-4783-8cde-a78d8081184a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:52.908135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2923-7ca4-4783-8cde-a78d8081184a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:52.911119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 167/328] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:52.912969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2923-7ca4-4783-8cde-a78d8081184a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:52.937558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:52.975043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0f6-13f2-4947-a4cd-cb4dee6202d3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:53.013281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:53.014232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.014524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.014894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] PATH_INFO: `/v3/users/09d6cb736d994f2883abea5f544ecb45` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.015101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2923-7ca4-4783-8cde-a78d8081184a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:53.016186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] RBAC: Authorizing `identity:get_user(user_id=09d6cb736d994f2883abea5f544ecb45)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:53.017744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d0725-d76b-4b7c-84b2-bf355d596343 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:53.019981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 162/329] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/users/09d6cb736d994f2883abea5f544ecb45 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:53.020924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.021232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.021514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.038383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:53.039581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:53.053778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:53.054532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.054818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.055097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.056015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] RBAC: Adding query filter params (role.id=9c471d3de2704894a7e696d1506c0e16, user.id=8a3ecae4b1db4689940c550276ee97fd, scope.system=all) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:53.056335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:53.057823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:53.069473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 168/330] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jun 15 14:33:52 2022] GET /identity/v3/role_assignments?user.id=8a3ecae4b1db4689940c550276ee97fd&scope.system=all&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:53.070332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:53.106793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:53.114897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 163/331] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:53.139087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:53.209871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb1a-07c3-493f-b7cd-130040d0e77a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:53.216966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:53.250348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:53.251367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.251654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.251971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] PATH_INFO: `/v3/system/users/09d6cb736d994f2883abea5f544ecb45/roles/2b9e067f7bea48d2818bfa304de6347e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.254033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=09d6cb736d994f2883abea5f544ecb45, role_id=2b9e067f7bea48d2818bfa304de6347e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:53.255496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166050b6-a9fc-4fe4-aad9-40cb5d47447b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:53.259673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374bd5d-87f3-4e0b-a9c4-b122df053406 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:53.295950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:53.296748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.297028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.297302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.298468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:53.299942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:53.301550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 164/332] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:53.307557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:53.348860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 169/333] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jun 15 14:33:53 2022] PUT /identity/v3/system/users/09d6cb736d994f2883abea5f544ecb45/roles/2b9e067f7bea48d2818bfa304de6347e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:33:53.418680 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad6d7-7732-4e60-ac24-d995cfd68e95 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:53.455549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:53.456251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:53.456540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:53.456817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] PATH_INFO: `/v3/groups` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:53.457523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:53.459577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83f1b-295e-4d0a-9efe-c685f209dc44 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:53.462763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:53.565569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 165/334] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Jun 15 14:33:53 2022] POST /identity/v3/groups => generated 226 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:33:55.767439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555cf-576b-4391-bc15-3af4dc64e590 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:55.768419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555cf-576b-4391-bc15-3af4dc64e590 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:55.768918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555cf-576b-4391-bc15-3af4dc64e590 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:55.770485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 170/335] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:55.777502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:55.778011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:55.778106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:55.800625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:55.801845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:55.889552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 166/336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:55.935434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22555cf-576b-4391-bc15-3af4dc64e590 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:56.053564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:56.073927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22555cf-576b-4391-bc15-3af4dc64e590 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:56.119598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:56.120454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.120737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.121010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.138455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-7048b4ec-06f3-4f1a-a5e6-9b28e1768a30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:56.147136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:56.149405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:56.150182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 171/337] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:56.156980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:56.264315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad2a6-5248-4c2d-958f-80ae6367676a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.264628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad2a6-5248-4c2d-958f-80ae6367676a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.264874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad2a6-5248-4c2d-958f-80ae6367676a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.266266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 172/338] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:56.272258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.273024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.273495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.302662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:56.308593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:56.315976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b0e01-6134-45a4-8f39-2e1060eeae6d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:56.362521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:56.383565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:56.395586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:56.400702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 167/339] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:56.405858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:56.439607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 173/340] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:56.545486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:56.557099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a8f1-7bfe-46fd-9ad7-688c23deed04 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:56.600830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:56.602365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.603888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.605136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] PATH_INFO: `/v3/users/09d6cb736d994f2883abea5f544ecb45` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.608444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] RBAC: Authorizing `identity:get_user(user_id=09d6cb736d994f2883abea5f544ecb45)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:56.610998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:56.613340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 168/341] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:33:56 2022] GET /identity/v3/users/09d6cb736d994f2883abea5f544ecb45 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:56.619326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:56.696340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:56.734741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba090c-b1e5-431a-901c-9b6f49cd8a3e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:56.741946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:56.801880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:56.802734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.803012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.803282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.825887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:56.828498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9eb1d-d87c-4a4d-af33-2eeeff53c38b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-2eed353c-0652-4ba5-8293-d73434492af1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:56.837733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:56.838695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:56.839599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:56.851870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 174/342] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:33:56.853214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a414-944f-47ad-861b-6bed5e1beeef None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.853497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a414-944f-47ad-861b-6bed5e1beeef None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.853769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a414-944f-47ad-861b-6bed5e1beeef None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.855116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 175/343] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:56.883987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d69a-3bd2-448d-a687-90bd8855ad19 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.884299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d69a-3bd2-448d-a687-90bd8855ad19 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.884539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d69a-3bd2-448d-a687-90bd8855ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.898276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:56.899272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:56.899795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:56.900355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:56.901472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] RBAC: Adding query filter params (role.id=2b9e067f7bea48d2818bfa304de6347e, user.id=09d6cb736d994f2883abea5f544ecb45, scope.system=all) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:56.902084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:56.903829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:56.915108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8935d69a-3bd2-448d-a687-90bd8855ad19 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:56.918636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8935d69a-3bd2-448d-a687-90bd8855ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:56.934510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 169/344] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jun 15 14:33:56 2022] GET /identity/v3/role_assignments?user.id=09d6cb736d994f2883abea5f544ecb45&scope.system=all&role.id=2b9e067f7bea48d2818bfa304de6347e => generated 510 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:33:56.935781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.106643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 176/345] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:57.152829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf176-3240-48bd-bdc9-87fa7e930392 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.153507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf176-3240-48bd-bdc9-87fa7e930392 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.153985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf176-3240-48bd-bdc9-87fa7e930392 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.156001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 177/346] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:33:57.157114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bf176-3240-48bd-bdc9-87fa7e930392 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.173880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00a25-f18e-449e-89b1-1f25c3ac7080 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.195394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.232394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.233088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.233377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.234120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.234904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:57.235671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:57.237630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5854-0dab-448f-a45a-457043d5efca None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:57.253231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 170/347] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:57.255276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.255570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.256580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.270578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.288829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:57.290080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:57.337277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bf176-3240-48bd-bdc9-87fa7e930392 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.381926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.382777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.383135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.383410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.400170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:57.403752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 171/348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:57.404899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:57.409117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:57.410017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:57.410853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 178/349] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:57.419293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.521767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e92aa6-f0c3-451f-b440-99e377f65a07 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.524531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.530503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a60e-ceab-4c22-a565-8a196c41bbb7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.558953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.560974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.561808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.562229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.562654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.569376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.570181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.570596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.570972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.571868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:57.572295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:57.573787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:57.586111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 179/350] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:57.591678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.639063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:57.640973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:57.705544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674d653-0f42-4d17-8911-5a3e10aa267a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.750445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.751430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.751850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.752235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.754304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 172/351] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:57.755457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.760658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.771742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:57.780932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:57.784657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 180/352] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:57.785453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:57.843016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:57.881930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015960a6-e9ae-4218-8e29-56c58500f0a4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.911718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e277fd-9b1a-4ddd-b582-dcd7f6c20803 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:57.924471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.925136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.925425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.925704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.959778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:57.960715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:57.960715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:57.960990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:57.962966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:57.964558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:57.966309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 181/353] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:57.967320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.021412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.022900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68be64-ee2b-4441-a3a0-135751c2cdca None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.028565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.105003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b5e-cb37-4425-8eee-026017d4980d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.123000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.142131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.143165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.143460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.143723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.144598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:58.144900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.146289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906b7d1-8b28-4031-bfa3-be344ae925c9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.159278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 182/354] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:58.160689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f343-5103-4443-8ec7-bc03fbecd503 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.160986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f343-5103-4443-8ec7-bc03fbecd503 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.161270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f343-5103-4443-8ec7-bc03fbecd503 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.163465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 183/355] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:58.164268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f343-5103-4443-8ec7-bc03fbecd503 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.166865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 173/356] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:58.172508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.173135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.173770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.194670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:58.196381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:58.283344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 174/357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:33:58.283344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.301503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f343-5103-4443-8ec7-bc03fbecd503 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.323899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.344496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.345367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.345649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.345921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.353857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.355317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.357087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 184/358] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:58.358400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.408502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ea02-51d2-476a-a5be-4f3bdb10c315 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.408725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.452711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.453600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.453793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.454075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.455325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.456796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb324ff-7eeb-4fe8-a5ed-3467e4ac5157 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.459170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 175/359] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:58.460111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b459-5126-4ce3-84a6-cd6bad9b1bc1 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.460397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b459-5126-4ce3-84a6-cd6bad9b1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.460674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b459-5126-4ce3-84a6-cd6bad9b1bc1 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.463845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 176/360] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:33:58.463845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19b459-5126-4ce3-84a6-cd6bad9b1bc1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.481020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f562-1aa9-4904-9efd-bb0f75dce740 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.521659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.522314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.522600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.522879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.593668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19b459-5126-4ce3-84a6-cd6bad9b1bc1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.595873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.608113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.610171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.646516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.647332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.647637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.648077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.660644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:58.667005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:58.669089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:58.670004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:58.670977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 177/361] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:58.671652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.748059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 185/362] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:58.748924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.795083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066de8b-f5e2-4b5a-981d-91762ca44131 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.837469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.838133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.838422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.838694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.839539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:58.839887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.841338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f4f4a-bb72-4263-b312-b3537d9b23cd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.847969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 178/363] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:58.848338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.848619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.848891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.870896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:33:58.872762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:33:58.885481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3003-fdba-45ab-b623-1b469e2beb9e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:58.911102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.947011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:58.947985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:58.948274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:58.948884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:58.951318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:58.953144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:58.955103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 186/364] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:58.955768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:58.973536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:58.979126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 179/365] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:33:58.980249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.098364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b66d0-5d9e-49c2-a7e8-7d87321a6538 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.106973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ccf6-820b-4dce-987d-d1e4a5a7a638 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.141749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.143504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.143504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.143504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.143768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:59.144398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.147784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.153503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.154384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.154667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.154949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.156056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 187/366] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.156224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.156843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.157750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.159703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 180/367] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:58 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.160498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.204230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.244310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.285580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2e20-2096-402c-b5fb-88b74709123b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.312558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ec23d-87bf-462e-bbcb-19b2269c4260 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.336548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.337567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.338066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.338529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.339571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:59.340062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.341523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.347888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 188/368] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.348646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.366612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.367763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.368074 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.368350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.382287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:33:59.390284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:33:59.391266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:33:59.392565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 181/369] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:33:59.393230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.481237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c213-bd28-42e4-8b0b-63cc55e84353 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.514276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.522831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.530092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.530092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.530092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.530092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.534216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541665-a6a5-4c02-a011-c9c4a4828b36 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.577431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.578375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.578668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.579315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.581334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.583100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.586505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 182/370] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.587735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.618180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.619749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.725907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e15d4-4bcf-4792-81ba-64fa7f29222c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.775238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 189/371] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:33:59.776176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.792465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.793165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.793455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.793780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.794557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:59.794929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.796329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.806999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 183/372] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.807986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.821853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.827615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:33:59.913347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc6e6-cbc1-4bbc-af89-c40694b01dbe None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.932337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5ee4-2116-47e4-92e9-755c70e9ef2a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:33:59.951875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.952521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.952809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.953085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.953921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:33:59.954233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.955676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.967909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 190/373] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.969029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:33:59.975518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:33:59.976911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:33:59.977389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:33:59.977866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:33:59.979377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:33:59.981315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:33:59.983895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 184/374] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:33:59.989714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:00.088236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:00.113051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad135f-3ade-4ed0-a669-dd3c30d55503 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.121671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:00.127187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b04b6-2cdd-4c0e-b523-0b1ce5c461b5 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.172078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.172261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.172661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.172944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.173219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.174062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.174532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.174992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.180218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.182171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.184591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 185/375] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:00.191265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:00.249852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.255905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.364181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:00.368055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 191/376] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:00.373872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:00.391088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8e04-25ce-4d8c-a3be-3ccd7c554993 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.444610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.445186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.445472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.445749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.446593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:00.446909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.449807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.456313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 186/377] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:00 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:00.517991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa53b7e-93ee-494f-9e54-6eb7e827dab3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.561212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.562138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.562460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.562736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] PATH_INFO: `/v3/projects/8e584b507784426894a201cd6de6602d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.564052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] RBAC: Authorizing `identity:get_project(project_id=8e584b507784426894a201cd6de6602d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.565554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.567772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 192/378] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:00 2022] GET /identity/v3/projects/8e584b507784426894a201cd6de6602d => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:00.573019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:00.604823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:00.726530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5ca1-7d7e-4fe8-88a2-651dfb56cf6b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.766287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.767166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.767449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.767719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] PATH_INFO: `/v3/groups/0aca5528f1244f7392f4b182c70d3c21` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.775216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] RBAC: Authorizing `identity:get_group(group_id=0aca5528f1244f7392f4b182c70d3c21)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.776756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c974-b8b1-45e3-a3b6-77bc5b5f6ed2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.779638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 187/379] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:00 2022] GET /identity/v3/groups/0aca5528f1244f7392f4b182c70d3c21 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:00.785225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:00.879881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:00.918346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24225c-ab7a-4ab1-b1fa-991f80e7d50b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:00.968792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:00.969558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:00.969842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:00.970116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:00.970955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] RBAC: Adding query filter params (group.id=0aca5528f1244f7392f4b182c70d3c21, role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=8e584b507784426894a201cd6de6602d) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:00.971263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:00.972840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00405d-e632-4be5-b836-019dc385a9ed None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:00.984596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 193/380] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:00 2022] GET /identity/v3/role_assignments?group.id=0aca5528f1244f7392f4b182c70d3c21&scope.project.id=8e584b507784426894a201cd6de6602d&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:01.338624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c580d-f62f-43c2-b527-e427cef2b06c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.339134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c580d-f62f-43c2-b527-e427cef2b06c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.339218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c580d-f62f-43c2-b527-e427cef2b06c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.341038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 188/381] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:01.346097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.346383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.346656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.369042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:01.370286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:01.458114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 194/382] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:01.493669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c580d-f62f-43c2-b527-e427cef2b06c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:01.595832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:01.626925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c580d-f62f-43c2-b527-e427cef2b06c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:01.671451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:01.672343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.672633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.672910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.690378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:01.699040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:01.700309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:01.701369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 189/383] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:01.712969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:01.798270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:01.847378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddc5e9-0331-4611-88d3-845dba53b7bc None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:01.891566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:01.892497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.892928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.893345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.894237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:01.894711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:01.896898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb73ee9-17fb-4a39-8b28-4408f23e5af0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:01.906569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 195/384] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:01.912670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:01.918244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed228a5-0c95-4104-bfb0-62223b80378f None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.918725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed228a5-0c95-4104-bfb0-62223b80378f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.919571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed228a5-0c95-4104-bfb0-62223b80378f None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.921356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 196/385] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:01.926115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:01.926405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:01.926686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:01.944898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:01.946236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:02.062416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 197/386] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:02.095675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90474f21-8894-4ed2-8d5d-1de743147ec2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.107671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.170833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.171709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.172015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.172291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.173576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:02.175097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:02.177160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 190/387] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:01 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:02.183823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.201876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:02.207564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:02.295225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37e0ab-98ce-4c97-b3d9-dc8e75bd196d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.362453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.363188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.363465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.363733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.372941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c2f3-1f76-4072-a776-e7e8155d7ba3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.386320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:02.401887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:02.402835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:02.403665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:02.407449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 198/388] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:02.409500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.440102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.440972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.441254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.441527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.442916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:02.445245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:02.446938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 191/389] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:02 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:02.453704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.605481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:02.634282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c28d9-39bd-4e92-8325-047cd64602d3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.644940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:02.655997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7427-5d4d-468a-a529-d89d71c0ac6c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.683843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.684529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.684808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.685081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.685835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:02.686136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:02.687520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:02.710366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.711324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.711609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.711909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.712150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:02.713459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.714031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, group_id=6c9863b1ee9a494898180f70e89cb6f2, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:02.715460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:02.806101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 192/391] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jun 15 14:34:02 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:02.856076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a2176-72be-41e6-940e-a52f522bd71e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:02.899937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:02.900740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.901022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.901292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.902534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:02.903999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff258c-7f2d-46d5-ae6a-2d2182f11f2a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:02.906615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 200/392] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:02 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:02.911320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:02.931556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9d3d-8e59-4be6-80cb-bc5a3dfcba00 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.932141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9d3d-8e59-4be6-80cb-bc5a3dfcba00 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.932141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9d3d-8e59-4be6-80cb-bc5a3dfcba00 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.933573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 201/393] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:02.939281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:02.939554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:02.939909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:02.969607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:02.970819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:03.049201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:03.078446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 202/394] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:03.101661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.103314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c675-9199-4bb0-bfd2-26f2772ec390 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.178309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:03.179296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.179589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.179901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.181296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:03.182969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:03.184732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 193/395] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:02 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:03.190534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.197016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:03.218536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e2438-a4cf-4036-bf99-abc39629cdf0 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.268569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:03.269393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.269672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.269943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] PATH_INFO: `/v3/roles/member` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.309325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:03.325847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:03.326820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:03.327619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 203/396] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:03.333286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.355900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbe0fd-c83c-4048-8f57-9efc68e5d3d4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.406739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:03.407643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.407958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.408238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.410542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] RBAC: Authorizing `identity:create_grant(project_id=00b9fef2e80b4df59d2e5024b8670c73, group_id=6c9863b1ee9a494898180f70e89cb6f2, role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:03.412676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f94f5-bbcd-44ad-af6d-47707800d6eb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:03.418495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:03.488295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cefca-dceb-461c-8828-01533e6b2aac None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.507982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 194/397] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jun 15 14:34:03 2022] PUT /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:34:03.509563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b567-58ff-4f2a-8d02-1ca0075047e5 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.509854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b567-58ff-4f2a-8d02-1ca0075047e5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.510149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b567-58ff-4f2a-8d02-1ca0075047e5 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.511795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 195/398] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:03.522115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedaf1-c745-44a1-92ea-9324c4bea5ab None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.523307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedaf1-c745-44a1-92ea-9324c4bea5ab None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.523307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedaf1-c745-44a1-92ea-9324c4bea5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.537910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:03.538998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.539497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.539979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.540963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:03.541595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:03.544212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:03.556143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 204/399] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:34:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:03.556566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4fbedaf1-c745-44a1-92ea-9324c4bea5ab None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:03.557899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4fbedaf1-c745-44a1-92ea-9324c4bea5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:03.571007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.714902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:03.737136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 196/400] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:03.738866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84fb8-bd53-419c-800c-437de7d447d7 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.739108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84fb8-bd53-419c-800c-437de7d447d7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.739382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84fb8-bd53-419c-800c-437de7d447d7 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.740725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 197/401] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:03.746999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.747283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.747557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.769747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:03.771055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:03.783482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:03.790111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca72c-fadb-47a8-a714-abe1f1a389a7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.832545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:03.834668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:03.835163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:03.835847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:03.837632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:03.839779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:03.842525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 205/402] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:03 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:03.848104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.861116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 198/403] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:03.869068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:03.978715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9f6a-9787-496a-b1b3-2aeba4bd5743 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:03.984050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6276f-d824-4dbc-954a-609bcdd47c20 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.011945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:04.017047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.017871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.018154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.018431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.026803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.029549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.029549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.029549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.030364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.032104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.032465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:04.034251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 199/404] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:03 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:04.035227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:04.044716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:04.045726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:04.046563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:04.049985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 206/405] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:04.051396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.090663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:04.158633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454bf6-882e-4639-bd30-684eeb202482 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.178386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab926a-0e3a-4550-88b2-2fb7ab63cca8 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.196962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.197900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.198184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.198455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.210503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:04.217386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.218526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:04.218850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:04.219703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:04.220546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 200/406] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:04.221863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.222355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.225163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.227717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, group_id=6c9863b1ee9a494898180f70e89cb6f2, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.229546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.282783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:04.316460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 207/407] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jun 15 14:34:04 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:04.318719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.373298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf515f3-cd06-4140-84a2-4668e4a3b09b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.447923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.448665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.448918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.449155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.450197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:04.450504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.451933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.475261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 201/408] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:04.481198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.516209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:04.538452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5067a-2164-4c94-8c44-8942e8596a22 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.587596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.588835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.589315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.589886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.590835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:04.591335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.593383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.604343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 208/409] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:04.612788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.638015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea3562-7d55-495d-a0d3-daba1e07bd83 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.653470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:04.676968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.678583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.679071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.679544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.681046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.682813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.685122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 202/410] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:04.691419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.814969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f392-cd90-4215-b158-aa10008ea3c2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.893933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:04.894809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:04.895088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:04.895360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] PATH_INFO: `/v3/groups/0aca5528f1244f7392f4b182c70d3c21` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:04.902006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] RBAC: Authorizing `identity:get_group(group_id=0aca5528f1244f7392f4b182c70d3c21)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:04.903797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:04.905522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 209/411] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/groups/0aca5528f1244f7392f4b182c70d3c21 => generated 229 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:04.915175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:04.936071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e71a-c5b6-4f8a-b74b-129e9e21002f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:04.956829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:05.005613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.007442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.007956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.008295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.010073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:05.012115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:05.019839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 203/412] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:05.019839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:05.082819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a725e9-41cf-48d7-9534-0118adfad13b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:05.083500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:05.139483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.140930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.141418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.141892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] PATH_INFO: `/v3/projects/8e584b507784426894a201cd6de6602d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.148695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] RBAC: Authorizing `identity:get_project(project_id=8e584b507784426894a201cd6de6602d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:05.150845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:05.152469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547eef-b290-4307-a5e4-b0bb69eb927e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:05.153693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 210/413] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:04 2022] GET /identity/v3/projects/8e584b507784426894a201cd6de6602d => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:05.166367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:05.195504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.196572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.196867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.197146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.199915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8, group_id=6c9863b1ee9a494898180f70e89cb6f2, role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:05.201453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4333a-419e-4eec-bfcb-5327aa0bfccf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:05.278199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:05.299245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19ac-977c-4306-8576-ae5f7440df8f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:05.300492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 204/414] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jun 15 14:34:05 2022] PUT /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8/groups/6c9863b1ee9a494898180f70e89cb6f2/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:34:05.307851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e88e-4186-43ef-9da4-6a4c4c6967d6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.307851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e88e-4186-43ef-9da4-6a4c4c6967d6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.307851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e88e-4186-43ef-9da4-6a4c4c6967d6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.307851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 205/415] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:05.311554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.311873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.312147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.362063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:05.366620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:05.416433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.417345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.419190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.419478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] PATH_INFO: `/v3/projects/8e584b507784426894a201cd6de6602d/groups/0aca5528f1244f7392f4b182c70d3c21/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.425473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e584b507784426894a201cd6de6602d, group_id=0aca5528f1244f7392f4b182c70d3c21, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:05.426963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:05.503531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 206/416] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:05.539652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 211/417] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jun 15 14:34:05 2022] PUT /identity/v3/projects/8e584b507784426894a201cd6de6602d/groups/0aca5528f1244f7392f4b182c70d3c21/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:34:05.539875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:05.600504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:05.681796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f06de-ce92-4cfa-92de-b2e2fc407ec5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:05.728601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.729470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.729772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.730061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.746898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:05.755178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:05.756864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:05.757650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:05.758453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 207/418] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:05.765852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:05.909413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128cd3-5871-46a3-9a6f-9fe1bc3a0fc7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:05.951727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:05.952400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:05.952630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:05.952904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:05.953661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] RBAC: Adding query filter params (name=member) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:05.954102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:05.955348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67534-5f91-4ea0-b29e-80693ccd98bd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:05.964649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 212/419] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:05.974165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.092453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae64c43-17cb-45c4-a4b5-c7532ec3003c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.092954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae64c43-17cb-45c4-a4b5-c7532ec3003c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.093029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae64c43-17cb-45c4-a4b5-c7532ec3003c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.094639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 213/420] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:06.099787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.100104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.100384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.107490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:06.129190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:06.130424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:06.157858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:06.164740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a721b-8008-430f-8b9b-c710b4f94787 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:06.237658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:06.238717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.240979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.241697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.278455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 214/421] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:06.312153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.369224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:06.372011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:06.489989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:06.495608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 208/422] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:06.498464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb995a4-21a7-4407-af76-2a5fd08dd191 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:06.501182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.565050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:06.565869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.566160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.566425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.573496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:06.587921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:06.604468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:06.605449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:06.606262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 215/423] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:06.612096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.622356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8897a-88e4-46c4-9d97-d2239c2f60f0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:06.660898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:06.662794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.663295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.663774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.665501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:06.667338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:06.669765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 209/424] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:06.676284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.785778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9fd7f-f097-439e-9eed-45f55077f115 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:06.813919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:06.853285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:06.853952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.854247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.854489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.855242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:06.855568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:06.856983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:06.872141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 216/425] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:06.875758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.883526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6090a3-3d37-4ee6-981a-430fe8ba580b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:06.954565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:06.955426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:06.955706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:06.955999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:06.958520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:06.960249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:06.965891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 210/426] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:06.967629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:06.985721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.082216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7f717-791d-4db7-b69d-c0c786612483 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.117116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9755-a23c-468b-95a2-cb7f32c6e139 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.160587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.161250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.161527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.161798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.164561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:07.164951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:07.166767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e69cc-7d63-494d-8c4a-b8d6892651b1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:07.168344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.168999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.169288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.169398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.169566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.176928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 211/427] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:07.180511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a338-dda6-4006-8c61-c9f7d9cf5d6c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.181083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a338-dda6-4006-8c61-c9f7d9cf5d6c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.184881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a338-dda6-4006-8c61-c9f7d9cf5d6c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.184881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 212/428] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:07.188869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.189178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.189460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.209336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:07.210748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:07.263967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:07.266087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:07.300368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 213/429] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:07.346795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.374940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.449478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 217/430] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:07.454954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.493493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e2ee-41c6-44ac-b180-986644bc987f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.525982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.535929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.537515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.538129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.538475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.550506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:07.562843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:07.563786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 14:34:07.564725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:07.571875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 214/431] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:07.574071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.592720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705d43-2c19-4796-aad4-0ae8fc39982c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.640676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.642107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.642839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.643321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] PATH_INFO: `/v3/projects/00b9fef2e80b4df59d2e5024b8670c73` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.645557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] RBAC: Authorizing `identity:get_project(project_id=00b9fef2e80b4df59d2e5024b8670c73)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:07.647795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:07.650909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 218/432] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/projects/00b9fef2e80b4df59d2e5024b8670c73 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:07.660839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.696202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.698393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8752d-a078-4c9e-8357-e50f54cded0b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.741105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.741792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.742080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.742362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.743128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:07.743442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:07.745116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:07.754817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 215/433] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:07.760633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.780810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b850d6-ee81-4cb6-81e7-493165b31bfe None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.828885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.837803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.838615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.838900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.839551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.843704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:07.843704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:07.845761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 219/434] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:07.852581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:07.900101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499077-2187-4a96-b890-8e609c33fef4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:07.940911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:07.941923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:07.942408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:07.942900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:07.970869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:07.980679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa220-5cf5-436d-b512-ac968ddd5864 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.030556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.031373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.031660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.031940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.032056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.032809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=00b9fef2e80b4df59d2e5024b8670c73) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:08.033123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.033417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.034566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e6db-09e7-410d-9b46-0aa1ba72ab60 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.043728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 220/435] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=00b9fef2e80b4df59d2e5024b8670c73&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:08.045737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0109a-5b66-4f7e-8787-b5f36b8c51d7 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.046047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0109a-5b66-4f7e-8787-b5f36b8c51d7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.046480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0109a-5b66-4f7e-8787-b5f36b8c51d7 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.048327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 221/436] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:08.055436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.055878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.056163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.080540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:08.082019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:08.100656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.166774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 216/437] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:08.172756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.181749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 222/438] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:08.207775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.306355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3039-f725-4fb1-ab88-b5649f106121 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.322554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.345809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032e33-ae36-4748-87f8-9e13d914922e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.354806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.355700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.356038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.356319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.357657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.359402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.366966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 217/439] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:08.368058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.392165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.400392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.402068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.402444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.402766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.415202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-191cc1fc-20ef-4f20-916e-c2de95dec7d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:08.423634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:08.424547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:08.425404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 223/440] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:08.426482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9dce-13bc-4965-99ef-a7a0a5172862 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.426719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9dce-13bc-4965-99ef-a7a0a5172862 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.426997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9dce-13bc-4965-99ef-a7a0a5172862 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.429399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 224/441] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:08.434795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd9dce-13bc-4965-99ef-a7a0a5172862 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.492917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a99e1-282b-43b7-998b-017509a414e4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.534984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.535879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.536163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.536431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.537918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.539364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e28e75-953f-4dc0-ada9-a7c65c5c0190 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.541085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 218/442] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:08.542247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.542514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.542784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.559370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:08.560595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:08.560771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd9dce-13bc-4965-99ef-a7a0a5172862 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.596226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.596938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.597227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.597499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.598252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:08.598563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.600682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.608679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 225/443] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:08.609468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.620592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.633798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 219/444] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:08.634748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.654098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.712734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43107423-d1f3-49f2-98c0-ba602ad57f7a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.738131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3787e-89e0-4ffc-88a9-2046f65d8829 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.747341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.748023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.748301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.748569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.749452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=9c471d3de2704894a7e696d1506c0e16, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:08.749762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.751227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.757584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 226/445] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=9c471d3de2704894a7e696d1506c0e16 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:08.758466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.785819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.786489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.786772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.787106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.843525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.861821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:08.863318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:08.879347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbed4-93da-4561-91c4-420f3e3d312b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:08.884586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:08.922044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:08.923055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:08.924037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:08.924037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:08.936202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:08.944873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:08.945774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:08.946563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 227/446] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:08.952689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:08.984596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 220/447] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:08.989888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.075124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e05eb3-b043-438e-ae98-13201e018598 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.109005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.111489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fcd7-b457-41da-8380-bbaa5086b34b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.117205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.117886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.118170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.118448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.119218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:09.119520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.120984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.132355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 228/448] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:09.133223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.138697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.151563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.152527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.152834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.153101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] PATH_INFO: `/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.154304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7a515ba9cb4d58bd26c5bb127f61d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.155732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.157475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 221/449] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:08 2022] GET /identity/v3/projects/7d7a515ba9cb4d58bd26c5bb127f61d8 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:09.163075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.238404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79390e8-714f-40b6-a780-5e6918e79bc7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.264058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6c4c6-955e-42c5-820b-c085856e90d3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.272358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.273004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.273285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.273568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.297210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.298058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.298333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.298600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] PATH_INFO: `/v3/groups/6c9863b1ee9a494898180f70e89cb6f2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.299761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] RBAC: Authorizing `identity:get_group(group_id=6c9863b1ee9a494898180f70e89cb6f2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.301291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.303457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 222/450] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/groups/6c9863b1ee9a494898180f70e89cb6f2 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:09.309540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.334893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.342200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.343659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.362433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.410890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e8e1e-226d-4f90-84f5-78cf2414abfd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.442863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 229/451] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:09.449250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.455339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.456015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.456299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.456718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.457623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] RBAC: Adding query filter params (group.id=6c9863b1ee9a494898180f70e89cb6f2, role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:09.457938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.459576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.465428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 223/452] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/role_assignments?group.id=6c9863b1ee9a494898180f70e89cb6f2&scope.project.id=7d7a515ba9cb4d58bd26c5bb127f61d8&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:09.547131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.554503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b70fc6-0e46-404a-8f4f-6ad1d9502b11 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.590073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.590967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.591263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.591586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] PATH_INFO: `/v3/projects/8e584b507784426894a201cd6de6602d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.592888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] RBAC: Authorizing `identity:get_project(project_id=8e584b507784426894a201cd6de6602d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.594447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.596183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 230/453] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/projects/8e584b507784426894a201cd6de6602d => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:09.602820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.706206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3d2e-8a2d-4381-8ca3-ed087f7729c6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.722891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:09.741868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.742731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.743013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.743288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] PATH_INFO: `/v3/groups/0aca5528f1244f7392f4b182c70d3c21` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.744495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] RBAC: Authorizing `identity:get_group(group_id=0aca5528f1244f7392f4b182c70d3c21)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.745934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aed79-3c1d-4c77-83bf-303269b81ca3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.747544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 224/454] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/groups/0aca5528f1244f7392f4b182c70d3c21 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:09.753569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:09.855313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9342-9e68-4b9e-b24e-af602c7fce63 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:09.888038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:09.888686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:09.888970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:09.889248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:09.890072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] RBAC: Adding query filter params (group.id=0aca5528f1244f7392f4b182c70d3c21, role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=8e584b507784426894a201cd6de6602d) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:09.890384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:09.891838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855bef8-81f4-4cda-bccc-ad5ffa3ca798 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:09.898012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 231/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jun 15 14:34:09 2022] GET /identity/v3/role_assignments?group.id=0aca5528f1244f7392f4b182c70d3c21&scope.project.id=8e584b507784426894a201cd6de6602d&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:12.713035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ba05-25df-4207-8abb-3885cd7cb376 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:12.714122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ba05-25df-4207-8abb-3885cd7cb376 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:12.714670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ba05-25df-4207-8abb-3885cd7cb376 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:12.716494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 225/456] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:12.722671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:12.723709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:12.724246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:12.753635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:12.754878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:12.767355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e69f3-b81b-4711-8f70-be21b70908e4 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:12.767999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e69f3-b81b-4711-8f70-be21b70908e4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:12.768510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e69f3-b81b-4711-8f70-be21b70908e4 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:12.770340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 226/457] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:12.775222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:12.775768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:12.776269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:12.780056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:12.808446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:12.809659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:12.867197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 232/458] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:12.895077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:12.921367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 227/459] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:12.958651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.018007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e583b3d-4050-43cb-bc1a-67f65423d335 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.056556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.057719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.058205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.058604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.070960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.072843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.074310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a554a-93c9-4d75-adb2-023ce8d98f85 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.089563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-98e190a6-3463-4d81-8a2c-c1f44c72c3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:13.094587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:13.095629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:13.096679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:13.096679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:13.096679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.096679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:13.098661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 233/460] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:13.100465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210c54-e247-47f1-bd3f-87b653573a13 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.100900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210c54-e247-47f1-bd3f-87b653573a13 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.101303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210c54-e247-47f1-bd3f-87b653573a13 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.103070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 234/461] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:13.104114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210c54-e247-47f1-bd3f-87b653573a13 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.115870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.116756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.117195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.117327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.117732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.128700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.130472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-a722a3ae-8eea-4011-a58b-0cb639fb698c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:13.150040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:13.151124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:13.152014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:13.152014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:13.152014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.152014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:13.154166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 228/462] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:13.155476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.155768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.156087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.173482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:13.174920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:13.226743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210c54-e247-47f1-bd3f-87b653573a13 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.249932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 229/463] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:13.252204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.288440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.289469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.289941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.290409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.291423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:13.291991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.293673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.314002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 235/464] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:13.315233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.372196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.378415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddda10-26a2-4da7-89ff-6f3681232ec2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.395369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.417555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.418532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.418532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.418816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.419583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:13.419935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.421388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.432067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c902-b088-4dc9-b3e3-7eccf47a52fc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.438523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 230/465] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:13.438523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.476910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.477709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.477989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.478260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.493671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.495433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-95a81cd0-c5e8-4c91-9dff-d5730814c5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:13.514458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:13.515399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:13.516604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:13.516604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:13.516604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:13.516604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:13.516604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 236/466] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:13.517074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a521-1cb5-4ca1-8e5f-5644f0bdd1fc None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.517252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a521-1cb5-4ca1-8e5f-5644f0bdd1fc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.517529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a521-1cb5-4ca1-8e5f-5644f0bdd1fc None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.523766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 237/467] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:13.523766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a521-1cb5-4ca1-8e5f-5644f0bdd1fc None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.560966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a448f-e6b6-46af-b276-03787d9b7f7e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.598240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.598906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.599194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.599470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.600743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.602172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.645094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a521-1cb5-4ca1-8e5f-5644f0bdd1fc None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.667145 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.680588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.681253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.681538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.681806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.682513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.684007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9ef1-018e-4234-a941-021aa2af71c3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.718369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 231/468] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:13.719256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.745605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:13.822250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 238/469] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/users => generated 246 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:13.823491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97b8-4e6c-48bb-8401-ce3947e0a7d5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.823779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97b8-4e6c-48bb-8401-ce3947e0a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.824295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97b8-4e6c-48bb-8401-ce3947e0a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.867920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-55da97b8-4e6c-48bb-8401-ce3947e0a7d5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:13.869205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-55da97b8-4e6c-48bb-8401-ce3947e0a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:13.889760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b5aa-a385-42ef-a545-33adc8c9fbfc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:13.952090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:13.952954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.953088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.953330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.955275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:13.955591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:13.957369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dad87-90e2-4c93-a88a-5568ed6e2f94 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:13.973300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 232/470] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:13.975034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b75f2-a12f-4518-b6de-346e70a6ee1e None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.975388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b75f2-a12f-4518-b6de-346e70a6ee1e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.975734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b75f2-a12f-4518-b6de-346e70a6ee1e None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:13.982387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 233/471] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:13.982712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b75f2-a12f-4518-b6de-346e70a6ee1e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:13.992369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 239/472] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:13.994000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:13.994469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:13.994945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.014773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:14.015995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:14.080931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:14.109701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 240/473] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:14.110925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.131846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b75f2-a12f-4518-b6de-346e70a6ee1e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.165432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:14.176089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.176790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.177071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.177349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.178862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:14.180607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:14.245615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b3c8a-8102-45b7-8a33-67577999a82d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.286179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 234/474] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:13 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:14.286977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.292627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.293462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.293742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.294018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.310345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:14.312486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:14.342117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:14.343118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:14.344011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:14.344011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:14.344011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:14.344011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:14.344011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 241/475] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:14.351329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.479046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7b87-85dd-4684-b0d7-755047ae449d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.512426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:14.521353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.522147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.531690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.531849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:14.531949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.531949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:14.531949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:14.532127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2ffc-ac7b-4153-83d2-801e883e6d1c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.570587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.571254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.571525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.571822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.572556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:14.572856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:14.574284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:14.575596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.sql.core [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 14:34:14.575596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 14:34:14.575596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [parameters: {'id': 'ef9f19bf8d3f47448a41450c566b7bdd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 14:34:14.575596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87016) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 14:34:14.588961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 242/476] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:14.593881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result.read() Jun 15 14:34:14.597165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:34:14.598115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application yield resource Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise self.value Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application session.commit() Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 14:34:14.599045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.session.flush() Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application compat.raise_( Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 14:34:14.601609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:34:14.603783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result.read() Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:34:14.605767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [parameters: {'id': 'ef9f19bf8d3f47448a41450c566b7bdd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:14.616277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 14:34:14.618318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.620309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 235/477] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jun 15 14:34:14 2022] POST /identity/v3/roles => generated 144 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:14.620309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.765603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c057b1-e4d7-4eb3-8396-ff1e29edfae2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.794642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950830-33e9-4f9a-a2ab-e747d2a1b150 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:14.850698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.852051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:14.852952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.853951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:14.854424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.854906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.855385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:14.856335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:14.856806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:14.859029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfd566-39fb-483d-9c3e-51d466879eb0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:14.880181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:14.890413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:14.898142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:14.898938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 236/478] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:14.901100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:14.957467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:14.975288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 243/479] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:14 2022] POST /identity/v3/users => generated 249 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:15.011632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3609d1a-0e71-46f9-a206-50d7a9f3508e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:15.051210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:15.051912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:15.052201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:15.052538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:15.053353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:15.053664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:15.055096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd0be-738b-4e16-807a-2050e0ecc75a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:15.064715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 237/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:16.367879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1f4f-69fe-4644-b836-98a1e7eb962a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.368402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1f4f-69fe-4644-b836-98a1e7eb962a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.368476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1f4f-69fe-4644-b836-98a1e7eb962a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.370193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 244/481] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:16.375396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.375925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.376002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.395962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:16.397911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:16.419923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed667-8581-4610-ab9f-7a70cc81e5ac None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.420252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed667-8581-4610-ab9f-7a70cc81e5ac None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.420483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed667-8581-4610-ab9f-7a70cc81e5ac None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.422157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 245/482] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:16.432049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.432343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.432628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.451221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:16.466502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:16.477059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:16.500433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 238/483] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:16.546500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:16.582198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 246/484] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:16.628041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:16.662987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:16.729853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965548e-3671-4b46-9fd3-abdef6e6bdb2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:16.782236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702da48-c964-47d9-8c0b-d038811b8c5a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:16.799840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:16.800670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.800954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.801230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.812496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:16.824250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:16.825449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:16.826235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 239/485] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:16.828987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:16.848750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:16.849714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:16.850586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:16.850864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:16.858811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:16.877379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:16.888702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:16.890789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:16.892841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 247/486] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:16.904290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.031177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746dd29-7f34-4924-a926-ff7c037da09d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.034280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8725ae7-9c2c-432c-a979-7404345efa6c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.038842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.071246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.071673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.072401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.072554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.072949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.073401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.074091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.074392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.074604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:17.075302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.075407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:17.075712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.077091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b13ea-189b-4af0-bcff-75f79e825284 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.077207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.087060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 248/487] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:17.088224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 240/488] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:17.089016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2ffa-a97f-4bdd-b9dc-da176ae90afa None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.089302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2ffa-a97f-4bdd-b9dc-da176ae90afa None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.103860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2ffa-a97f-4bdd-b9dc-da176ae90afa None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.103860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 249/489] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:17.104050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.104124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.104124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.104124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.114966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:17.117176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:17.216029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.243829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 250/490] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:17.243829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.292474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415d82-b4ce-4f49-b7f7-71b99364fda3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.338108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.339257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.339662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.340936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.356606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.358262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.380344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090dff1-bbe5-4eaa-9917-a8fbd6152b26 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:17.382234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:17.383331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:17.384210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:17.384210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:17.384210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:17.384210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:17.384210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 241/491] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:17.384876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.410060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.429526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f28aa-e295-457b-80b3-355735037522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.430948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f28aa-e295-457b-80b3-355735037522 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.432201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f28aa-e295-457b-80b3-355735037522 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.432485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f28aa-e295-457b-80b3-355735037522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.449423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f28aa-e295-457b-80b3-355735037522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.451629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f28aa-e295-457b-80b3-355735037522 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-010f28aa-e295-457b-80b3-355735037522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:17.476477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:17.477407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:17.478275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:17.478275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:17.478275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:17.478275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:17.481154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 251/492] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:17.482120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f28aa-e295-457b-80b3-355735037522 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.518593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843156-0e6b-46dd-b4e1-9e462bd23a75 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.538118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.575705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.577152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.577485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.577774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.591846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:17.602938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:17.603960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:17.604758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:17.607775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 242/493] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:17.609002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.632376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f28aa-e295-457b-80b3-355735037522 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.674662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.675722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.676230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.676699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.677624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:17.678899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.680679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.693374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 252/494] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:17.694638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.721666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.748294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32eb-fb70-4822-ae1e-06e36121c70c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.784216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.784884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.785166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.785435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.786183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:17.786484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.788541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca21a45-8c7b-413d-913f-32ca97d64c59 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.800563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 243/495] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:17.805587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf186af-dddf-4542-91ac-b0c762ff11f8 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.806130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf186af-dddf-4542-91ac-b0c762ff11f8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.806836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf186af-dddf-4542-91ac-b0c762ff11f8 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.809122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 244/496] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:17.810686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf186af-dddf-4542-91ac-b0c762ff11f8 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.812900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:17.817198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33557-e218-4b4e-825d-ad1f2b1bffe8 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.854921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.855592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.855905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.856193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.856943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:17.857247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.858642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.867733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 253/497] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:17.868414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:17.939146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf186af-dddf-4542-91ac-b0c762ff11f8 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.978836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:17.979767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:17.980080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:17.980354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:17.982163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877eacc-c357-4c3a-ac13-6d852471866f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:17.987520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:17.988929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:17.991504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-1fc377a5-fdb3-4a34-b787-4740b82ab636 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:18.005938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:18.007057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:18.008099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 245/498] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:18.008916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0d79-ecdd-4315-ae17-acfe84c56117 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.008916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0d79-ecdd-4315-ae17-acfe84c56117 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.009045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0d79-ecdd-4315-ae17-acfe84c56117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.020201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.020950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.021226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.021608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.025767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-175b0d79-ecdd-4315-ae17-acfe84c56117 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:18.027660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-175b0d79-ecdd-4315-ae17-acfe84c56117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:18.030396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.031870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:18.047931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:18.048843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:18.049725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 254/499] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:18.050368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.073341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.111869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 246/500] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:18.111869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6783b2-4f4a-42b7-b49d-8ccc48b0d3d1 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.111869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6783b2-4f4a-42b7-b49d-8ccc48b0d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.111869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6783b2-4f4a-42b7-b49d-8ccc48b0d3d1 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.111869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 247/501] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:18.112413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6783b2-4f4a-42b7-b49d-8ccc48b0d3d1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.168323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e9c2-0038-4c31-8137-e2ba5a0ba254 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.201491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.202276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.202551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.202818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.213672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.215148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.220605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6783b2-4f4a-42b7-b49d-8ccc48b0d3d1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:18.233407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:18.234439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:18.235480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:18.235480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:18.235480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:18.235480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:18.235480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 255/502] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:18.236027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.252271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.260070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.265769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbede4d-ad6f-446d-bd43-42786111e37d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.302384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 248/503] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:18.304847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.304847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.304847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.309812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.322066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:18.323267 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:18.341377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5ff1-cd36-4a17-b7a1-f1e5a3395aad None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.376125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.376784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.377061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.377338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.378165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:18.378469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.379966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.390519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 249/504] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:18.391429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.417314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 256/505] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:18.418082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.498675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4cfa2-aa17-4826-b88e-ecd46529d27d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.515776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.518947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c5c7-363b-404f-9081-b4c2016d12d2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.533582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.534402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.534690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.534967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.545830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.547316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.548021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.554290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.554948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.555225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.555497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.556251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:18.556556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.557934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:18.566071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:18.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 250/506] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:18.574376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.574700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 257/507] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:18.574700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.670039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4a53-b266-4207-a4e9-2608161a6c97 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.673155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a53d7-cc85-45af-97ed-c577f0588875 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.704651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.705481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.705756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.706024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.708196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.709168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.709459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.709744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.717056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:18.725473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:18.727263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 258/508] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:18.728981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.754608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.779015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.786721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.789212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.827314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f7eb-1f67-4452-a90d-b91bf04b03ba None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:18.860718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:18.861433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:18.861700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:18.861902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:18.889159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 251/509] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:18.893963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:18.929857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:18.931333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:18.957865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.980869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:18.993671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008487-8796-4b52-be2a-957c0942b190 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.028934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.029791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.030013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.030288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.031934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 259/510] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:19.032940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.042639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.044164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:19.059493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:19.060559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:19.061442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 252/511] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:19.062002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.137062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba9fe3-a2b3-4e94-afac-0e79167f458c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.164213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be4621-394f-46b3-8902-60de6d926144 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.170392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.171052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.171341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.171619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.172380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:19.172689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.174070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.186259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 260/512] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:19.187064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.195827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.199558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.203909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.204567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.209630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.209630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.209630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:19.209630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.209630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.215628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 253/513] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:19.216448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.294137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bb17-8966-429f-b6bf-4771054ebb2b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.315699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f050-dc29-4f3d-9922-44455c915059 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.328460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.329246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.329526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.329804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.340501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.341972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.348400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.349179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.349461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.350265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:19.360267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:19.361177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:19.362049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:19.362049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:19.362049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.362049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:19.362270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.362270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.364100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 261/514] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:19.364929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:19.381567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:19.382524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:19.383363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:19.383363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:19.383363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.383363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:19.383363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 254/515] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:19.383623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.427715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.433382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.474138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c092d8-5421-4f54-a194-06f69ad66196 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.485877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a876-402d-4432-915e-1f32facca9a9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.508782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.509464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.509746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.510027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.510863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:19.511171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.512686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.522813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.523479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.523762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.524068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.524777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.526206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.530412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 262/516] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:19.531217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.611174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 255/517] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:19 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:19.612136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.637730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff4cc-b998-48bc-b775-ed7012b106f3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.663975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.680971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.681790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.682071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.682338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.693503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.695084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:19.717130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:19.718072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:19.718899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:19.718899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:19.718899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:19.718899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:19.718899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 263/518] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:19.719756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.740876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.745389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75841808-0ac8-45f7-8c8b-a2f60daaf5a4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.785279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.785750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.786038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.786319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.787174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:19.787514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.789180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.805182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 256/519] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:19.806061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.843504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea22e-5f37-4a6e-a773-13eff073af93 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.882811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.883782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.884090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.884364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.885144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:19.885458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:19.886890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:19.904152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 264/520] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:19.904901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:19.919155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e603ca-6894-4a33-b113-ab96858858b6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:19.938151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:19.957110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:19.957759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:19.958163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:19.958355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:19.987840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.016752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb15f4-8df3-4043-9592-2f94ea115998 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.031854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.033364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.056646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.057320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.057607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.057883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.058715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.059032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.060615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.072841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 265/521] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.073715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.142445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 257/522] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:20.143605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.182463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.191819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc56c6-3ed9-4e57-86b7-ad2d19ddc8e5 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.206771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.227270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.228213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.228499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.228885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.236570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.238088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.250672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b5ebc-fa6e-471b-a96d-5c304bdb5c9e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:20.253152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:20.257901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 266/523] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:20.258766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.290251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.291046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.291329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.291604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.299427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.300987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:20.317012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:20.317963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:20.319467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 258/524] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:20.321424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.369520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffeb2e-14d3-465c-ad91-4f34e5b396a7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.406607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.407320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.407607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.407918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.415835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.417298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:20.432324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:20.433247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:20.434672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:20.435173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc61f-8707-4bd9-8e7f-6bf57789621b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.435502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 267/525] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:20.435502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.452725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.457507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.475988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.476787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.477071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.477347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.487823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.489295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:20.509227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:20.510107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:20.510943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:20.510943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:20.510943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:20.510943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:20.510943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 259/526] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:20.511284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.548124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec6913-8fb1-48ce-b4d2-3709650e0d95 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.586517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.586768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.587017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.587250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.588065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.588368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.589850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.607796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 268/527] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.607796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.623923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6833b40-4d6b-421c-8142-0ca5f3c4672d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.660187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.660773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.661087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.661345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.662216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.662535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.663989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.687515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 260/528] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.687515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.694069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.719821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.724767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669f29b-6e08-4af2-b75b-d66d12db555a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.775024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.775708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.776016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.776291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.777133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.777884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.779739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.799446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 269/529] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.805618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.809542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8bb2-110f-4525-a147-afa82c1e6051 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.846186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.847147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.847640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.848145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.849070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.850111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.851836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.864673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 261/530] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.866543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.921421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27985fe-6c62-4bdd-b481-72c189ca7cd1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:20.952244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.959279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:20.960193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:20.966651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:20.966651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:20.966651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=150269945dcc49b0ac4f074e88312177) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:20.966651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:20.966651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:20.967239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:20.979831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 270/531] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/role_assignments?user.id=150269945dcc49b0ac4f074e88312177&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:20.979831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:20.988721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff903-2a91-40b2-933e-129bd60ea8f3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.038125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.038998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.039283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.039556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.040461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:21.040773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.042258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.053648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 262/532] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:21.053648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:21.150162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f38f4-d4a5-462a-8887-242d24538308 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.196493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d49b15-a9f4-4144-82ce-6d375eed8f34 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.239993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.240879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.241301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.241583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.274287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.275787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.275787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.275787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.285361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.288271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:21.308538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:21.309447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:21.310294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 263/533] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:21.316010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:21.337803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:21.355840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:21.357365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.359056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.441524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958bf9-eef4-40c0-a595-5987187f7499 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.483460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.484095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.484379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.484654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.487828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:21.487828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.487828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.502603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 264/534] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:21.509139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:21.571477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 271/535] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:21.578032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:21.591104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:21.618593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305647-5cd4-4b49-b82f-f559907ab39a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.692054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.692832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.693125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.693941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.695163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=146205bc397741d2b8c8d69f94523b0c) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:21.695584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.697215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.708323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:21.713760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4724553-30df-4eef-a570-79ada5dfc98f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:21.714492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 265/536] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:21 2022] GET /identity/v3/role_assignments?user.id=146205bc397741d2b8c8d69f94523b0c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:21.768863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:21.769586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.769863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.770130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.782815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:21.784347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-885c913b-3ba9-4145-af07-5f88de8be080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:21.808067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:21.808973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:21.809827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:21.809827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:21.809827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:21.809827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:21.809827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 272/537] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:21.816104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:21.872553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0587c-bd5e-4227-a514-544f1accba53 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.873060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0587c-bd5e-4227-a514-544f1accba53 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.873517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0587c-bd5e-4227-a514-544f1accba53 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.876037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 273/538] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:21.883680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:21.884266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:21.884756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:21.924874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:21.926100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:22.002362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2a5c-95ed-4563-a2ba-c1b733fd97e1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.047380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.048026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.048314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.048586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.049311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:22.049613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:22.050985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:22.067679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 274/539] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:22.068010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:22.075988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 266/540] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:22.081620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.115721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.234017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:22.265435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858ed5-f815-481e-9185-999abc0267cf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.327396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.328632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.329263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.329746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.340669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012f48-d1ee-47c1-b60e-32bd5645dfb1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.341071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:22.342880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:22.372371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:22.373373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:22.374226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:22.374671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 275/541] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:22.380827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.387400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.388240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.388528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.388805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.423499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:22.437169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:22.438127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:22.439332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:22.449357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 267/542] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:22.462231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.551014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484459a-9db1-4112-8a9a-8c502bfbae0a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.593688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993516e6-eea6-469a-878d-800f15944674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.594415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993516e6-eea6-469a-878d-800f15944674 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.594619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993516e6-eea6-469a-878d-800f15944674 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.594891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993516e6-eea6-469a-878d-800f15944674 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.595689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993516e6-eea6-469a-878d-800f15944674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:22.596022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993516e6-eea6-469a-878d-800f15944674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:22.597815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993516e6-eea6-469a-878d-800f15944674 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:22.605661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:22.611740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:22.623836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 276/543] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:22.632625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993516e6-eea6-469a-878d-800f15944674 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.694713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127355b-7a70-43ab-997d-f6c93a31570e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.765202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.765879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.766161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.766429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.767181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:22.767482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:22.768883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:22.786001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 268/544] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:22.792457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:22.815753 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993516e6-eea6-469a-878d-800f15944674 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.885544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:22.886131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:22.887139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:22.887427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:22.888576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=b24c24b909be4ce0aacd6b0fb765a637) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:22.888891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:22.890345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:22.904843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 277/545] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/role_assignments?user.id=b24c24b909be4ce0aacd6b0fb765a637&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:22.960991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825901f7-c60a-4165-b6de-04d0b81a7fdc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:22.987382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:23.011568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:23.012423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.012709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.012983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.028098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:23.033565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:23.053719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:23.056078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:23.058187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:23.058187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:23.058187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:23.058187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:23.058187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 269/546] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:23.064907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:23.175065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:23.232916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebf85-810f-4c9b-ad54-455eaa0b965e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:23.281899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:23.282587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.282871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.283523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.284010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:23.284323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:23.285915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:23.299032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 278/547] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:23.308828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:23.442583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca868c-e7ac-4ec0-be12-da7451ccb8f4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:23.488655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:23.489574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.489873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.490148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.500366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:23.501801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f6b5b5ab-d92b-41bc-8756-d427abe2f0c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:23.519278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:23.521731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:23.524340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:23.525609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 270/548] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:23.532926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:23.684475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638411e8-8b51-42d0-a83a-809ccd2717d9 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:23.714609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0247-33c4-4d3d-b045-f206e59adc6c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.714802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0247-33c4-4d3d-b045-f206e59adc6c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.715073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0247-33c4-4d3d-b045-f206e59adc6c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.715560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:23.716712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 271/549] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:23.721165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370817-e269-47d2-a1e7-b935d38af700 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.727462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370817-e269-47d2-a1e7-b935d38af700 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.727462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370817-e269-47d2-a1e7-b935d38af700 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.727462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 272/550] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:23.727462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.734423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.734423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.738022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:23.738702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.739059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.739441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.741002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:23.741356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:23.743051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08c659-c326-4cc4-bf76-e71db25ab814 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:23.757434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:23.758966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:23.764151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 279/551] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:23.765480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:23.765763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:23.766036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:23.791701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:23.791701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:23.796870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:23.850503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 273/552] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:23.851870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:23.871688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 280/553] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:23.884701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:23.966862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3a3f-1e69-4af7-82a3-ea447c290e7e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.014592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.015526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.016125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.016569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.027110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde857f-04d6-4f84-89f2-89611527777a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.041079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.059798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.082094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.083392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.084220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.084683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.100802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:24.104898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.106353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:24.113034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:24.114053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:24.114883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:24.117945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 281/554] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:24.118739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.228177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 274/555] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:24.229081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.267953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11899305-abd0-4b17-b6dd-c0c3e6b2474d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.305961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.322061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.323734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.324251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.324789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.339025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:24.346890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:24.348225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 282/556] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:24.349676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.356624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6267-e00b-4571-a9bc-493dd02632ad None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.381775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.394384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.395124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.395410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.395944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.396485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:24.396855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.398222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad278f-d674-44e1-aebb-ac3e1ecb37d1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.411352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 275/557] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:24.412784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e697-959f-4ddf-a69b-66ce014f8488 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.413097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e697-959f-4ddf-a69b-66ce014f8488 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.413438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e697-959f-4ddf-a69b-66ce014f8488 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.418945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 276/558] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:24.419699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554e697-959f-4ddf-a69b-66ce014f8488 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.461303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fba0-10f5-432c-9ff5-38ea15ec4e5b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.500695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.501257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.501536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.501804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.513074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.514533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.530586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554e697-959f-4ddf-a69b-66ce014f8488 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:24.532206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:24.533124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:24.534000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:24.534000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:24.534000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.534000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:24.534000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 283/559] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:24.534285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.560600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.571501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.572206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.572487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.572759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.573499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:24.573803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.575431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfa003-139a-4ce7-be1d-251f7a39d319 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.584752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 277/560] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:24.585999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.588261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.588261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.602734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:24.603949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:24.632518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.652549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56793c0-3110-4bf0-aad9-543a3e526513 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.679500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 278/561] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:24.680924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.695479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.696350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.696635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.696934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.711005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.712525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:24.731646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:24.732710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:24.733626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:24.733626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:24.733626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.733626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:24.733626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 284/562] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:24.733914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.801665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754125-96ec-473c-a3f4-c77dba855958 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.821289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.840665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.841335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.841608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.841879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.842601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:24.842903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.844413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.857010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aac33-5d31-4a72-ad54-f8fb7948d81f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:24.861686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 279/563] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:24.861686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.892559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:24.898839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:24.899642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:24.902918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:24.902918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:24.911300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:24.913417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:24.931280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:24.932225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:24.933138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:24.933138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:24.933138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:24.933138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:24.937243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 285/564] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:24.938103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:24.973394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566439d-4b44-4354-bb33-88035dcb35f1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.011748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.012607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.012890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.013163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.025689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:25.036397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:25.037510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:25.038591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 280/565] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:25.039293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.055454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf4de5-696e-4191-b584-8e2c88207b93 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.084919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.093754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.094439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.094727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.095014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.095867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:25.096153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.097553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.115829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 286/566] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:25.115829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.218406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb3c0-b72c-434d-b087-6f30a69977c0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.232215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.254708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.255510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.255945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.256870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.264008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.265461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:25.279933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:25.281009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 281/567] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:25.286771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.290211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432610-65c5-4ba3-88e1-274d5144a43c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.327178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.327758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.328071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.328341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.329181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:25.329485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.330878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.344347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 287/568] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:25.345160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.379756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.386244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a315dd-5330-4774-80c3-cee716a45ffd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.422022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.422688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.422972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.423248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.424040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:25.424348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.425725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9bd5-1de6-4b45-bc85-db69cc415c8d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.434145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 282/569] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:25.436037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95ef2-0202-479f-814a-244eb410b984 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.436446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95ef2-0202-479f-814a-244eb410b984 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.436728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95ef2-0202-479f-814a-244eb410b984 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.438151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 283/570] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:25.438672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95ef2-0202-479f-814a-244eb410b984 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.453763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618619b-bf10-4489-8e29-f188b3ec3692 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.456179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.490435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.491318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.491589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.491884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.498954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.500449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:25.515563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:25.516610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:25.517552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 288/571] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:25.518155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.548241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95ef2-0202-479f-814a-244eb410b984 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.583093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.583678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.584001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.585079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.585988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:25.586301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.587722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb7f8-97c2-45f0-b078-cdb8311d34af None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.599842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 284/572] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:25.601075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.601367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.601649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.618158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:25.619354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:25.625000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08900-c8a5-4ae8-af7f-8feca42de034 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.633349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.659627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.682941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.682941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.682941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.682941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.682941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:25.684451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:25.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:25.686313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 289/573] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:25.686902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.698135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 285/574] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:25.698970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.716869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.796082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76d3f-8543-4153-8a31-5f45efd6c10b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.799044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751b26-e5bd-4d93-98e8-6b9be10073a9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.831358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.832188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.832473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.832750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.833937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:25.834596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:25.834971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:25.835249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:25.836146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:25.836453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.837894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.843572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:25.845150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:25.855383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:25.856219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:25.864671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:25.866224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:25.867173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:25.867173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:25.867173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:25.867173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:25.867173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 290/576] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:25.867650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:25.867902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.947433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:25.962988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe569-7ff6-44f8-abe8-4dab8f0611bd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:25.970202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13839f-26e1-40f4-999a-728183d740cd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.002642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.003298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.003585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.003893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.004734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=3b4d5d5ee8b54056b747948ee0aa4b7c) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.004986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.005110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.005653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.006681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.006965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.007249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.007822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.008143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.009568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.013775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 287/577] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/role_assignments?user.id=3b4d5d5ee8b54056b747948ee0aa4b7c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.014631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.030428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 291/578] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.031629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.109110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.147721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125edb4-a712-4088-946c-9b98ba2b19e2 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.148666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8a1b-b8be-4cea-957c-eeb48eee5f82 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.191482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.192296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.192577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.192678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.193063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.194086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.194580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.194954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.195325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.204663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.206123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.206819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:26.215133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:26.216248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:26.217239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 288/579] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:26.217963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:26.230841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:26.231850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:26.232966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:26.232966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:26.232966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:26.232966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:26.234296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:26.234296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.339967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327265c-11b6-4d85-982c-cda0cfb3b5f6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.371162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6e56-f8fa-44fc-807c-e9c15db0b72a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.372210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.379681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.381698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.382232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.382651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.383527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.384452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.386399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.399632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 289/581] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.400738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.420575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.421665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.422199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.422620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.437939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.440341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:26.464376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:26.465501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 293/582] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:26.471028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.513319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.528389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a131-ca2f-4417-9dde-93fbc4b2856e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.570666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f883f-a716-408a-885d-1433489a507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.571331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f883f-a716-408a-885d-1433489a507a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.571613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f883f-a716-408a-885d-1433489a507a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.571917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f883f-a716-408a-885d-1433489a507a None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.572741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f883f-a716-408a-885d-1433489a507a None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.573047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f883f-a716-408a-885d-1433489a507a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.574420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f883f-a716-408a-885d-1433489a507a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.583165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 290/583] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.584545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f883f-a716-408a-885d-1433489a507a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.592520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226903-2882-4f42-966e-fa684d92f3b1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.649239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.651704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.652572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.652859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.653136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.654504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.654825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.656768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.679169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 294/584] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.680009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.710559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f883f-a716-408a-885d-1433489a507a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.762785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.763588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.763904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.764186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.773835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.775723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:26.797728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:26.798784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 291/585] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:26.799891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.813287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.819033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe65bc-d8f5-46d8-85ba-9003f77b9235 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.869353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.870022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.870302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.870580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.871314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:26.871626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.873052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:26.886078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 295/586] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:26.886821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:26.929980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e4402-6685-4cfc-9922-7ba4c6b6055d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:26.944067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:26.968440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:26.969346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:26.970037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:26.970634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:26.985369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:26.986888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:27.005767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:27.007670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 292/587] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:27.009011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.012435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f6a0-902d-4de5-81ac-2c6cd4ccc1be None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.050701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.051932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.052565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.053161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.062087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.064205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:27.080659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:27.081734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:27.082673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:27.083533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.109944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.135242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6359b3-7aa5-4f3c-8341-5a9e295d4e6b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.175097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.175829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.176116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.176391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.177229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:27.177533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.180552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.200410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 293/589] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:27.201359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.213274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b719b0-2a33-463f-b6c7-85917c26098c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.226410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.252323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.253301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.253714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.253980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.263559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.265138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:27.279181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:27.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 297/590] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:27.281643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.313664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa556d7-419d-46ce-8ab1-da228cb1d71c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.349737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.350737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.351236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.351713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.352673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:27.353051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.354428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.365977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.372678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 294/591] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:27.372678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.394463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13482fce-c77b-4152-9c55-4974f4b3ab88 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.429889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.430733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.430965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.431236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.432066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:27.432378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.433818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.448557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:27.449457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.460445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.479154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9869c-8c49-4800-9b80-91c556a74a21 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.515479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.516303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.516584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.516904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.528350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.529872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:27.548557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:27.549469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:27.550567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:27.550567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:27.550567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:27.550567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:27.550567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 295/593] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:27.551112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.584077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac538-0e03-4997-ad9c-81a3c5119f2a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.624239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.624904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.625182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.625513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.626423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:27.626730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.628317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.636013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.641205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 299/594] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:27.641970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.669315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6e02-92e0-41cb-9025-980ae514a4fc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.711460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.712215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.712782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.713063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.715262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:27.721936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.723543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.750660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df780-3887-4195-93f7-cbdafeb2b86e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:27.750948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:27.752077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 296/595] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:27.757600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.790450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.791396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.791679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.791988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/150269945dcc49b0ac4f074e88312177/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.808823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=150269945dcc49b0ac4f074e88312177, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.810271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.872102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fb16-3fb3-4ff7-8677-8e68a6936cfe None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:27.886240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 300/596] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:27 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/150269945dcc49b0ac4f074e88312177/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:27.888556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.916470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:27.917451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:27.918054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:27.918480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:27.919530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:27.920018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:27.921614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:27.937809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 297/597] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:27.938990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:27.963598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.012960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.037382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc425-28eb-40b3-8285-09c2f18ad574 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.067717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec029b-3e60-4af9-9858-5cad3145c418 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.096002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.097208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.097672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.097987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.121274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.122337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.122840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.123222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.124568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:28.124848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=8b2601ad8d254730b33d16e6ed1156cf, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.125100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.126689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.126893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c1581-32ba-4990-9345-d98f3c777ca7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.190725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 298/598] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jun 15 14:34:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:28.191575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 301/599] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:27 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e7ff-e1fa-4101-bdce-b8bf55c40180 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e7ff-e1fa-4101-bdce-b8bf55c40180 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e7ff-e1fa-4101-bdce-b8bf55c40180 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 302/600] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:28.220106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26e7ff-e1fa-4101-bdce-b8bf55c40180 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.337970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e29f-3498-4840-9f3f-ddfd6abfe387 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.345292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26e7ff-e1fa-4101-bdce-b8bf55c40180 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.348221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.356214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.380720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.382876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.383433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.383977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.386298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.387209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.387569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.387949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.393372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.395055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.400805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.402424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-cb504742-3768-4d0b-ae85-e65a51a6b89d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:28.410985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:28.412101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:28.413190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:28.415450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 299/601] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:28.417046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.417512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.417973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:28.423868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:28.429039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 303/602] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:28.430139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.439774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:28.441221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:28.515879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 300/603] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:28.517179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.546331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271a47-9df8-466d-b5f6-3017676f0e0d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.585353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.586303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.586585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.586863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.588389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:28.588708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.590434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.611980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 304/604] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:28.614078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.632105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.636618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef330-1500-4a57-b9c1-1f4952e2c322 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.638642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.675068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.676577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.676862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.677145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.678051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:28.678470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.679879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.691878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 301/605] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:28.692784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.741880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012f423-4929-4060-8dd2-525effa9cdbe None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.780847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.781993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.782477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.782949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.795146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:28.804058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:28.805021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:28.805865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:28.806503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90aa4a-c98e-4da9-869f-b2807f6b0fe9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.808876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 305/606] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:28.809998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.842662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.843564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.843887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.844171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/146205bc397741d2b8c8d69f94523b0c/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.861128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=146205bc397741d2b8c8d69f94523b0c, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.862583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.886281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:28.924483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a90-540e-4c03-8e1c-b48110ccc6d5 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:28.959881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:28.960680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:28.960966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:28.961242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:28.967961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:28.969429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:28.987830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 302/607] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:28 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/146205bc397741d2b8c8d69f94523b0c/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:28.987830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:28.995984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:28.996892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:28.997824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:29.002393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 306/608] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:29.005435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:29.013948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:29.213477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0a4-e4eb-4032-a291-1d9165714337 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.216151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82be3f-69c0-4783-82e7-aa6862ce5b08 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.249111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:29.257167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.257843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.258135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.262481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.262594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.262712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:29.262712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.262866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.262866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.262866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.262866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:29.262866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.263231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:29.263321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:29.272593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 303/609] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:29.280312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:29.285544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 307/610] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:29.291030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:29.410400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:29.455713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a602d-86ce-4e2a-9da7-99b6d4c7e3ec None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.482712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf84ea-995d-4620-aabd-88b5c209a915 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.523681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.524512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.524798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.525073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.541473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.542935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:29.548496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.549387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.549668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.549946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/b24c24b909be4ce0aacd6b0fb765a637/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:29.577542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:29.578518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:29.579395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:29.579395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:29.579395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:29.579395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:29.581162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 304/611] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:29.583324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=b24c24b909be4ce0aacd6b0fb765a637, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.585636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:29.589204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:29.669292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 308/612] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:29 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/b24c24b909be4ce0aacd6b0fb765a637/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:34:29.735911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881708b7-b368-446e-ad53-76661f34d520 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.773433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:29.787850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.788589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.788990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.789270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.790098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:29.790411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.791832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:29.809293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 305/613] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:29.814764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:29.882539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:29.948378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c81-457f-4eb9-ae31-ab0d413d6335 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:29.986733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:29.987508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:29.987787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:29.988081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:29.996468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:29.997998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:30.022706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:30.023677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:30.024636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:30.028827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 309/614] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:30.032983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.171209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca156-134f-48ab-bad4-0ed6fbb31f47 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.215658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:30.216428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.216713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.216992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.217903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:30.218225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:30.219734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5554b-1301-4da6-866b-b71ca6640126 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:30.248785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 306/615] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:30.257660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.273992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e0f3-7d15-4281-bdbd-5e62c9cbde99 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.274289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e0f3-7d15-4281-bdbd-5e62c9cbde99 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.274561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e0f3-7d15-4281-bdbd-5e62c9cbde99 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.276277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 307/616] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:30.282728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.283017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.283297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.303548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:30.304969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:30.359931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:30.392553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 308/617] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:30.419706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.504953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:30.510555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159801-3ae7-4783-a7e1-bbfb1bbf3762 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.539776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd8c-c74e-4c3b-83a1-ebbd9dfe057d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.579631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:30.580477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.581155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.581449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.594025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:30.604427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:30.605348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:30.606310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 309/618] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:30.611904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.644599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:30.645469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.645803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.646081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.660173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:30.671025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:30.672540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:30.716311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:30.717288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:30.718178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:30.718178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:30.718178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:30.718178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:30.718178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 310/619] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:30.722492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5394b-f40a-4763-9f8b-1ab1309b8bf4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.723488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.799199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:30.802171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.802492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.802789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.804458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:30.804768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:30.806221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:30.826396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 310/620] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:30.832213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.901198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc87d-369e-4f87-a3ec-3cee91597412 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.939590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:30.940716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.940987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.941257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.941990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:30.942289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:30.943850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b960d66-efc3-48cd-b179-c70a5d266fb1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:30.948759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:30.956716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 311/621] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:30.957581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbc8d-f8ca-4e6c-b3a2-5eae97823787 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:30.958142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688946-4bd2-48dd-b4a1-077e04055e52 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:30.958434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688946-4bd2-48dd-b4a1-077e04055e52 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:30.958743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688946-4bd2-48dd-b4a1-077e04055e52 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:30.960793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 312/622] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:30.964657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688946-4bd2-48dd-b4a1-077e04055e52 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:30.982373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.005397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.006880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.007168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.007444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.019339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.021080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-81a9afca-896a-4974-9b6f-49ee278e17f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:31.041242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:31.042200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:31.043087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:31.043087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:31.043087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:31.043087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:31.047148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 311/623] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:31.048779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.049075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.049410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.068146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:31.070119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:31.101967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688946-4bd2-48dd-b4a1-077e04055e52 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.155960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 312/624] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:31.155960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.157903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.158725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.159054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.159329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.174066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.175562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:31.194821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:31.195761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:31.196686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 313/625] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:31.197183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.272514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.288117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.296061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b4ad-7f14-47e9-bdbb-ad9059ab9791 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.329771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac5803-4ba4-42f6-b6d7-30d3bfa20b1c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.333098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.356599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.357096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 313/626] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:31.357096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.370373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.371436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.372273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.372273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.386236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:31.394637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:31.396106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:31.397190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:31.403897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 314/627] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:31.403897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.496618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e23d4-a5db-4552-b983-93f6f3d1d4c6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.509071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d40d4-b78f-4b5d-80f2-a861fc186ff0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.531441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.532210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.532487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.532816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.533589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:31.533943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.535584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.538629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.543901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.544400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.544699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.545047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.549554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.555841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 314/628] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:31.555841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.557387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.558841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c60f7b73-1403-4f58-a583-87c160269f1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:31.573643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:31.574763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 14:34:31.576168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:31.580280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 315/629] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:31.581431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ffa3-c92b-471e-af3b-1a4d6025a2bd None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.581725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ffa3-c92b-471e-af3b-1a4d6025a2bd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.582003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ffa3-c92b-471e-af3b-1a4d6025a2bd None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.583293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 316/630] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:31.584334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3ffa3-c92b-471e-af3b-1a4d6025a2bd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.662202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c3f8-9264-491b-b3fb-db09ff22e049 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.696193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3ffa3-c92b-471e-af3b-1a4d6025a2bd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.699842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.700779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.701058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.701327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.702069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:31.702369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.703740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.712739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 315/631] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:31.713541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.743482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.744417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.744696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.744966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/3b4d5d5ee8b54056b747948ee0aa4b7c/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.761404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=3b4d5d5ee8b54056b747948ee0aa4b7c, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.763007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d85ba-a339-4842-a52b-9d2382b9b1ed None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.786636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.827840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55162d-e2b4-4cc8-a87d-fe0a948573d8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:31.844292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 317/632] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:31 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/3b4d5d5ee8b54056b747948ee0aa4b7c/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:31.845985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813125e-3110-4ee3-b806-18a89099367f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.846299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813125e-3110-4ee3-b806-18a89099367f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.846661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813125e-3110-4ee3-b806-18a89099367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.869131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3813125e-3110-4ee3-b806-18a89099367f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:31.870471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3813125e-3110-4ee3-b806-18a89099367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:31.873980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:31.874666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:31.875010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:31.875287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:31.876297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:31.876608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:31.878166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:31.901712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 316/633] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:31.904322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:31.925251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:31.973619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 318/634] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:31.977451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813125e-3110-4ee3-b806-18a89099367f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.031378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179fa64-a985-4153-8f33-6244511f08b5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.055039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.077936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.078745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.079013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.079678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.094150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.095875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.115212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813125e-3110-4ee3-b806-18a89099367f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:32.119645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:32.124824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 317/635] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:32.125756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.159880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.160547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.160879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.161153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.207707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.236283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.237812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88122e2-7d07-49cd-86cf-fdecbf4c5d5f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.261188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16699eb7-4215-45a9-9ad9-177518d39818 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.300459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.301348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.301544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.301820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.313130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:32.322035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:32.322984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 318/636] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:32.324349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.359197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 319/637] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edd06-e42a-4a73-9c0b-3299e05d3344 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edd06-e42a-4a73-9c0b-3299e05d3344 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edd06-e42a-4a73-9c0b-3299e05d3344 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 320/638] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:32.372370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edd06-e42a-4a73-9c0b-3299e05d3344 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.451541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863001-468f-4ea0-b98e-07deb98962ed None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.454285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.485559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edd06-e42a-4a73-9c0b-3299e05d3344 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.490111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.491331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.491620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.491988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.492676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:32.492963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.494350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.507976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 319/639] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:32.508809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.528233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.529307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.529765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.530212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.531136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:32.531749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.533331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc060-f4b9-41b1-b1b0-b432de578584 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.543377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 321/640] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:32.544812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.545100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.545378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.562851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:32.564272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:32.607010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.621476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67953fc-c0ba-4337-a700-9b743a6d411d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.649815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 322/641] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:32.649815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.654973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.655828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.656143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.656418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.668124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.669831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:32.689644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:32.690657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:32.691540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:32.691540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:32.691540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.691540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:32.691540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 320/642] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:32.692354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.721451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.765382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805d565-5eea-4316-9775-38d00c8727e9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.802759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.804212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.804495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.804771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.812603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.812851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e071b4-e5d5-48fa-9889-a4654018e910 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.814062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:32.829081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:32.830247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:32.831215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 323/643] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:32.831873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.857054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.858492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.858971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.859250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.871464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:32.873030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:32.874959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:32.892256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:32.893219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:32.894171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:32.894171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:32.894171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:32.894171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:32.894171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 321/644] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:32.894558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:32.949573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb5ec-30b7-49d9-91c5-16ed0f3abc63 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:32.973246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:32.986417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:32.987241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:32.987508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:32.987780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:32.999642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:33.005135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e413-b2ad-46e9-8846-107ce7b28abf None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:33.008439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:33.009723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:33.010891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:33.018204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 324/645] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:33.019006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.049199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.052673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.052673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.052673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.052673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.052673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.053856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.070774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 322/646] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.070774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.134745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.145294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598cb1-17d9-4c73-9cbf-dbfbac41a0a3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.186260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.186931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.187208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.187483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.188348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.188744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.190090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.190762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a1d1-7cea-49c9-b14f-8e52fa47bf14 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.211158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 325/647] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.211871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.229855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.230513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.230790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.231073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.231824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.232142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.233496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.245860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 323/648] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.246630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.267113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.330951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683a5ac-f5c3-4f7d-ad17-87a06fc2e8a1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.353102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643417f7-ed3f-47bc-9037-43bcfcafda12 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.368188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.369222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.369926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.370577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.370866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.371610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.371942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.373459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.382591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 326/649] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.383343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.393846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.394678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.394962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.395239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.404446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.405905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:33.421372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:33.422263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:33.423154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 324/650] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:33.423630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.510377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcbe92-0463-4303-a074-010058997fa4 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.514158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.534801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bab33-a2f5-489c-8ee9-5fa1475485ea None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.548998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.549775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.550063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.550338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.572216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.573027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.573313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.573592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.583191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.585257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:33.599789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:33.601277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 325/651] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:33.607061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.625284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.626780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.643483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.716317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49512c-8591-43a9-85c9-de9f5e07782b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.742080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 327/652] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:33.743010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.747428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.759943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.760858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.761366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.761827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.773430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.774941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:33.792840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:33.793924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:33.794859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:33.794859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:33.794859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:33.794859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:33.794859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:33.795178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.866812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28129-a92b-483c-a452-6f2abb2b81cc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.898046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:33.905094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.905758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.906038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.906312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.907101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.907408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.908916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.914551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427614-19ba-46e5-a863-0eba5717d539 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:33.922019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 328/654] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.923249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.961357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:33.962194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:33.962476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:33.963519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:33.964393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:33.964705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:33.966134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:33.986565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 327/655] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:33.987323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:33.999326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.041155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7bbd-72a4-425a-94fc-250e03d3a259 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.087507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.088371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.088658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.088943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.102848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.104640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.114890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6f03-aca3-46bf-9906-2b4635b90638 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:34.125966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:34.126846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:34.127757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:34.127757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:34.127757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:34.127757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:34.132883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 329/656] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:34.133739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.157533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.158198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.158477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.158750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.159471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:34.159774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.161193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.172982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 328/657] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:34.173777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.179193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.248779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abbf2-46ba-4f25-9322-5fa525499fa6 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.263975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.274445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97819c7-043e-452a-a487-bc992e32a7a7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.282104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.282749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.283029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.283303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.284171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=150269945dcc49b0ac4f074e88312177) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:34.284464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.285927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.293303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 330/658] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/role_assignments?user.id=150269945dcc49b0ac4f074e88312177&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:34.294722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.312606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.313274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.313559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.313835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.400358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.402505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.407191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.423669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8761c-9d50-4c7b-8940-d7b6f23e5210 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.468872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.469847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.470210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.470994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.471511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:34.472524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.473766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e1581-f443-46ae-ab3c-f8882bccc77c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.490734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 331/659] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:34.492659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a042-80b2-4cb3-921b-dbed260fbe3d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.493038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a042-80b2-4cb3-921b-dbed260fbe3d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.493391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a042-80b2-4cb3-921b-dbed260fbe3d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.495098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 332/660] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:34.499682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a042-80b2-4cb3-921b-dbed260fbe3d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.525619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 329/661] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:34.526618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.552746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.619236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a042-80b2-4cb3-921b-dbed260fbe3d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.654385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.655187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.655469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.655737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.663799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.665331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.673779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31c66-08ca-49d5-abe9-e8a35c455e88 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.677778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-801602ac-d2bd-4761-bb89-3a0d1b909f1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:34.680205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:34.681621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 333/662] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.682942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.683997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.702284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:34.703469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:34.722456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.723255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.723534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.723834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.737038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.738630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:34.752975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:34.753978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 330/663] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:34.760805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.790817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 334/664] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:34.793343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.832026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:34.877543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715c89-286b-499d-a637-7ba280edf996 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.908592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef3766-6fe8-48b2-b673-acbaa3215c36 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:34.919064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.919920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.920179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.920455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.931688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.933164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.947002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:34.947675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:34.947988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:34.948261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:34.949099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:34.949406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:34.950995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:34.951850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:34.952857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:34.952857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:34.952857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:34.952857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:34.953176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:34.956802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 331/665] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:34.957350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.971764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 335/666] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:34.972529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:34.984123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.072172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.074033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456cff-0c44-4303-ad76-aa317622a8e1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.084255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a708ac8-e483-47bb-aded-4e11edc9b316 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.111426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.112446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.112886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.113165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.113960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:35.114268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.116264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.121541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.127464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.127464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.127464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.134535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:35.134535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.143572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:35.156413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:35.157398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:35.158257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:35.158900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:35.159946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.219183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.242952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859b59-db84-484a-81e8-936a950d5354 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.276126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a202f-c614-43a6-8c15-7b5d880d4e5e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.280532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.281197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.281479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.281755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.282480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:35.282785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.284179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.298991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:35.298991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.319484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.320183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.320467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.320740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.339433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.403744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.405242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.410430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596ec1-66ab-400e-b876-c5435dfb20a9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.451650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.452339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.452627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.452967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.453930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:35.454067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.455462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.458898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.463106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 334/670] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:35.463957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.556790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 337/671] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:35.557694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.602977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce2f10-9568-4dd6-a123-2d2a32c13f6a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.632301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.655948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.656735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.657022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.657313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.658626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:35.658626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.659788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.672227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 335/672] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:35.673393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.701590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95123c5-3b47-4c3a-b8f6-cd4131bc2e81 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.751359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.752820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.753194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.753573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.763048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.765978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.766794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:35.788765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:35.790036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:35.791321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:35.791990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 338/673] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:35.793246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.816327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7989f0-4e89-46af-be02-311536f87be6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.857248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.858276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.858712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.859154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.871897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.873566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:35.893253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:35.894214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:35.895091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:35.895091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:35.895091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:35.895091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:35.897858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 336/674] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:35.898939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:35.901969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127837a-8ea1-4f99-9eca-47cf8bd4465d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:35.913672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:35.942673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:35.944510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:35.945338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:35.946140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:35.957721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:35.959528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:35.979532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:35.980639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:35.981638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:35.981638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:35.981638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:35.981638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:35.985952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 339/675] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:35.986908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.017777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f352b-ef03-4617-9501-0c82ed27e0b5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.034095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.057238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.058204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.058673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.059156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.060276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.060769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.062473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.078045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 337/676] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.079256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.102101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a1173-b89b-4b67-b48d-ab00ac4c3553 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.142151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.142743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.143026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.143304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.144184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.144483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.145864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.159369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 340/677] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.160514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.185591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.196317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ad-46d6-4f5b-8de7-047ed15690ca None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.234794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.235840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.236359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.236838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.237777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.238433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.240239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.254245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 338/678] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.255432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.281921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fc64f-6aa4-4a73-b5a1-53873d7fedd0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.294032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.320687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.321353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.321635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.321910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.322757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=146205bc397741d2b8c8d69f94523b0c) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.323050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.325971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.333376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 341/679] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/role_assignments?user.id=146205bc397741d2b8c8d69f94523b0c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.334762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.374238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412f68-c4a9-4368-abd6-79fb5ec1948f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.413963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.415145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.415745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.416202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.425064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.426926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.434127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:36.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:36.454345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:36.455244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 339/680] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:36.455731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801d6c-1083-4236-a1de-288148b56461 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.461177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.492000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.492877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.493161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.493462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.502244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.503943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:36.520574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:36.522303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:36.523451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:36.527530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 342/681] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:36.528687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.670007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c81e4-8db0-42a9-a9e0-b9a86fa8638c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.674342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.683534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb00ad-99dc-4044-a79d-d7ffe464f05c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.711427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.712344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.712645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.713165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.714609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.714609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.716153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34093415-c9aa-4da9-ad22-fd5a81a9fc21 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.725818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.726486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.726772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.727049 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.727879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.728191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.729637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.741517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 343/682] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.743035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af81e-968c-4d73-b231-c402f4951a6e None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.743334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af81e-968c-4d73-b231-c402f4951a6e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.743663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af81e-968c-4d73-b231-c402f4951a6e None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.744168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 340/683] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.745148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.746383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 344/684] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:36.750452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af81e-968c-4d73-b231-c402f4951a6e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:36.756765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.868630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac13d-5d00-4f09-b287-0b71e7f61b2a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.888239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af81e-968c-4d73-b231-c402f4951a6e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:36.910864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.911518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.911817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.912103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.933375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:36.934338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.934616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.934884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.935718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=b24c24b909be4ce0aacd6b0fb765a637) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:36.936055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:36.938054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2fad-10c5-4bcc-9403-825ff658e256 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:36.940074 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:36.948327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 345/685] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/role_assignments?user.id=b24c24b909be4ce0aacd6b0fb765a637&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:36.950450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:36.950737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:36.952565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:36.972857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:36.974186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:37.002684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.005189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.042864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:37.051625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 346/686] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:37.093301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.181374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 341/687] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:37.188300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.241720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf480ea-42c4-4baf-81ff-064cb2366f41 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.260165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:37.301392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.301624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.301945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.302613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.320264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.321287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.331903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117479c-f172-45b3-9b5e-fac92d8310de None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:37.344824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:37.345778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:37.346806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:37.346806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:37.346806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:37.346806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:37.346806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 347/688] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:37.351938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.380364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.382929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.383369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.383835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.397596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.399700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.421999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:37.422545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:37.423406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:37.424328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:37.424328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:37.424328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:37.424328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:37.430054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 342/689] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:37.434377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.503494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab33c-02aa-482e-bf74-3dfb48b41780 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.574540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.575755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.576207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.576623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.577495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:37.578138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.581137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.605310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 348/690] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:37.610602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.625731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af452071-0a04-42a0-9c83-b2cc4c6fe94c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.636753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:37.701427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.702115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.702400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.702678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.703426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:37.703739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.705540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.739431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 343/691] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:37.751828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:37.760524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ab31-6961-4786-b595-894a39b8d805 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.780346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:37.805183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.805873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.806154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.806425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.807147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.808979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9637-1669-4705-9b58-0c2cdc83a253 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.913696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88b30-a249-4c43-89de-df55d9c45075 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:37.948071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 349/692] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:34:37 2022] POST /identity/v3/users => generated 254 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:34:37.951336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23211c7-637c-4d05-aa46-743977c08a77 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.951628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23211c7-637c-4d05-aa46-743977c08a77 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.951938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23211c7-637c-4d05-aa46-743977c08a77 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.954257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 350/693] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:37.958612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:37.960222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.960532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.960811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.963175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:37.963462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:37.963729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:37.983125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:37.984770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:37.998002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:37.999912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:38.017910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:38.018888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:38.019797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:38.027689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 344/694] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:38.031234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.094388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:38.151858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 351/695] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:38.178877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.208561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e9ce-5288-409e-9e0f-2ca80eb5bba1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.257337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.258140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.258653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.258963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.260543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:38.261186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:38.264124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:38.283990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 345/696] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:38.285555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.291348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:38.299743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395cc3c-db1b-4b02-8f52-06c08b377155 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.341220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.342172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.342461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.342735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.355038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:38.363372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:38.366129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:38.368490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:38.375836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 352/697] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:38.375836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.390977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:38.411542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b021e5-d451-4830-a253-6519ce91fd88 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.455362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.456051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.456395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.456676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.457567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=3b4d5d5ee8b54056b747948ee0aa4b7c) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:38.457911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:38.459710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:38.469397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 346/698] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/role_assignments?user.id=3b4d5d5ee8b54056b747948ee0aa4b7c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:38.500928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd042-5bca-48f3-afd1-c381e3853493 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.547790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.548426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.548700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.548968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.549772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:38.550077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:38.551567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:38.562722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 353/699] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:38.568097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.722552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280896ad-2988-41fd-87a0-3dfe3e8dbbcc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.773739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.774955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.775465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.775983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.788947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:38.790693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:38.809625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:38.810553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:38.811448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:38.811448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:38.811448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:38.811448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:38.813765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 347/700] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:38.819345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.841176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:38.932337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb468d-4609-4627-b2e9-879509bfc0cc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:38.973736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:38.974405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:38.974685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:38.975003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:38.975779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:38.976111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:38.977574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e73e-989b-4922-9b4a-095fdec7b199 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:38.991099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 354/701] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:38.996537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:38.999774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.015760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cea89-4137-4d5c-b2d7-14965c2e4b80 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.016078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cea89-4137-4d5c-b2d7-14965c2e4b80 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.016345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cea89-4137-4d5c-b2d7-14965c2e4b80 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.017892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 355/702] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:39.022896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.023181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.023456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.041174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:39.042361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:39.127305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df19-81ba-48f7-ab84-79a71a895bf4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.130800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 356/703] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 14:34:39.157082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:39.172247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.182811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.183638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.184024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.184309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.203985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:39.205463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:39.235328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:39.236764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:39.237790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:39.240391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 348/704] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:39.246212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:39.301688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1db7e-15bb-41c5-805a-53f145f52e4d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.339662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.340548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.340831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.341130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.341902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:39.343353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:39.359594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:39.360838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:39.361962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 357/705] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jun 15 14:34:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:39.368333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:39.431575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.447853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.481308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032775-de9a-4d35-905e-a22527c0aea2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.518228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.519177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.519647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.520122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.521124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:39.522240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:39.524018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:39.529006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b126-13e8-48e8-a0a3-1c5e5d474bd9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.529840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 358/706] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:39.535579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:39.605280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.606359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.606853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.607344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.609456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:39.609980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:39.613107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:39.649691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 349/707] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:39.651044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:39.704174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c668-1c54-4bdb-8dc7-77a845e6fcda None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.769985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.770720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.771010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.771356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.772967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:39.773443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c566b-e1c5-4f15-be17-174616f0aab7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:39.780157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.783690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 359/708] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:39.798954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bc80a-b9a1-4e0f-83a4-a8e8ea50a1e9 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.798954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bc80a-b9a1-4e0f-83a4-a8e8ea50a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.798954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bc80a-b9a1-4e0f-83a4-a8e8ea50a1e9 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.798954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 360/709] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:39.800267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.800958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.802191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:39.839876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:39.841190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:39.845281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d1b4-211c-43f5-af4d-41e3e5cb8a51 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:39.870296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:39.890626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:39.891543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:39.892210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:39.895639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.005817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 361/710] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:40.031051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.032855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.036094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.188271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15358-7c2f-4cae-94fc-b78e21ad9bf4 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.192640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 350/711] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:40.198955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.223513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:40.252817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:40.274513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.275628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.276162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.276649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] PATH_INFO: `/v3/services/network` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.277519 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.279153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:40.315848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:40.317393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:40.318300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:40.319687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0f58-ed4c-4874-bc21-d108c39b7922 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.322320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 362/712] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:40.336269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.367018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.367913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.368201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.369367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.392730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.394210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:40.431952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:40.432901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:40.433780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:40.433780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:40.433780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:40.433780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:40.441596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 351/713] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:40.445645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.539470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:40.575594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc721d33-1dfb-4160-bb6a-0eb47fa94e28 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.589826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f02a07-ecd7-4d18-8c66-9d3c83bc4f12 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.618240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.623845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.639892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 352/714] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:40.642238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.681853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.682876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.683354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.683883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.684804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] RBAC: Adding query filter params (name=network) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:40.685320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.686927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.705611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 363/715] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:40.724999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.764984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12e82-1f5c-4f29-b7f4-9495bdbcea9e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.809917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.810640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.810926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.811576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.820949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.822566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.822679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:40.824780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b89c6dca-9426-4a4d-921a-83d86067bb94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:40.842710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:40.843695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:40.844788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 353/716] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:40.845720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f30f-a960-48c2-abaa-9398afefd8ac None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.846010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f30f-a960-48c2-abaa-9398afefd8ac None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.846293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f30f-a960-48c2-abaa-9398afefd8ac None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.847923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 354/717] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:40.849515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f30f-a960-48c2-abaa-9398afefd8ac None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:40.878691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b246b7-0bba-447f-886b-33e53bfabc3f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:40.919502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:40.920668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.921212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.921705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.922605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:40.923082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:40.924859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119feddc-b73e-485e-9ba8-08f3f8d405e2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:40.930708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 364/718] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:40.932353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:40.932828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:40.933262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:40.955845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:40.957449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:41.001200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f30f-a960-48c2-abaa-9398afefd8ac None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:41.043406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 365/719] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:41.060880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:41.061966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.062447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.062975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.064041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:41.064603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:41.066409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:41.081361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:41.088414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 355/720] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:41.096154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:41.197010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:41.214239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:41.252470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90675-2fd2-41b5-a99b-d0d7530512ef None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:41.311550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:41.312703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.313164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.313878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.340831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77c1a0-5297-444a-9cf2-fe420e48be3e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:41.341367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:41.357785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:41.358797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:41.359634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:41.360305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 366/721] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:41.365006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:41.391946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:41.392993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.393497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.393973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.395007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:41.395524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:41.398015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19c42-3ad1-4739-8f2b-11958dfe3686 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:41.416775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 356/722] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:41.433869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e9dc-4d02-4a5a-9af7-e45291ad632f None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.434511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e9dc-4d02-4a5a-9af7-e45291ad632f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.434999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e9dc-4d02-4a5a-9af7-e45291ad632f None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.436792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 357/723] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:41.442918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.444041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.444745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.470362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:41.473118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:41.599341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c471-916a-4cd0-bea3-ecb14839d1da None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:41.614933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:41.623894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 358/724] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:41.646602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:41.648292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.661610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.661610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.661610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:41.661866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:41.661945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:41.661945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:41.671829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 367/725] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:41.673475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:41.722618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:41.843825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c792-a33b-494b-8f2c-1c33cf8f4d61 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:41.904821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:41.905578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:41.905930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:41.906210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:41.926411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:41.942657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:41.943778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:41.944808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:41.945481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 359/726] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:41.950128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.069807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749594c5-1885-44fa-b03b-efb40fd002eb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.078341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:42.117544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.118382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.118693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.118987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.119779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:42.120111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.121702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.124727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e74a4-640b-40b8-acf4-ca4c5d97c8a7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.139659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 360/727] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:42.141242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.214550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.215735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.216244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.216720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.242534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.244383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:42.280605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:42.281572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:42.283090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:42.283090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:42.283090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:42.283090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:42.283090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 368/728] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 609 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:42.288863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.337601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:42.390237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6706dc-62b1-41af-9908-ed2ba693e4ce None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.422836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b127cc-68a7-410b-a601-aeaf5c7eb68f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.462105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.462771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.463050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.463366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.464128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:42.464431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.465840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2706f0-c960-4edb-bf61-fcd5e9cc270e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.471680 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.472509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.472794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.473073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.479297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 369/729] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:42.480655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437051e4-ef60-4ee2-85be-7c92e18d476b None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.480986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437051e4-ef60-4ee2-85be-7c92e18d476b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.481264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437051e4-ef60-4ee2-85be-7c92e18d476b None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.482798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 370/730] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:42.485942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437051e4-ef60-4ee2-85be-7c92e18d476b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.497868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.499762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-005d385f-34b8-4460-8031-5df095a50ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:42.523338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:42.524270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:42.525150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:42.525150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:42.525150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:42.525150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:42.525881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 361/731] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:42.527023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.527201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.530686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.549018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:42.550197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:42.569627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:42.591838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:42.614078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437051e4-ef60-4ee2-85be-7c92e18d476b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.639828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 362/732] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:42.639828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.681536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.682875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.683735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.684484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.698789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.701598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:42.720130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:42.721496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:42.722737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:42.730105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 371/733] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:34:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:42.737443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.785222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d0c5-887b-46e2-908b-6d308224d660 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.823443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.824618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.825057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.825733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.826605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:42.827051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.828600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.842560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 363/734] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:42.843631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:42.858238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:42.863274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbcb67-7d4e-47ca-b494-c8bbd23b1666 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.900556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.901219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.901502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.901775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.902501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.903898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:42.956897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fcd32-9b55-4ef0-a65e-d85cb9483daa None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:42.993027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:42.993616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:42.993894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:42.994166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:42.994995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:42.995297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:42.996862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.014116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 372/735] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:34:42 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:43.015500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.020430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.024904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 364/736] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:34:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:43.030592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.168694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221889b-d071-425f-88a4-37570fae73d0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:43.205628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.214867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:43.216140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.216645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.217163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.227091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:43.229416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:43.248190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:43.249149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:43.250081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:43.259150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 373/737] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:43.261603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.299063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1224e4-56fd-4b8d-b7f6-81eda53bc12f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:43.343186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:43.343899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.344190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.344461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.344913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.402346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480dde4-4268-4f7b-807f-903a77aec0ae None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:43.440433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:43.442297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bffde2-a2b6-40e3-aa08-8e1a35d68ceb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.450834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:43.452216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.453294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.453783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.455357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:43.455941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:43.458328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df393c0-89c4-4934-8c0f-100164f5ef8d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.488422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 374/738] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:43.491653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e928-4fe0-4a36-8948-88904bdc3150 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.492189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e928-4fe0-4a36-8948-88904bdc3150 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.492664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e928-4fe0-4a36-8948-88904bdc3150 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.495574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 375/739] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:43.496631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e928-4fe0-4a36-8948-88904bdc3150 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.534948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.573150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 365/740] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 14:34:43.574460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.574744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.575016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.597873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:43.599060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:43.629851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e928-4fe0-4a36-8948-88904bdc3150 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:43.650463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.668652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:43.669542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.669692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.670084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.690148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 366/741] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:43.691370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.776640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:43.778218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.822863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:43.828374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081d0b-d3b5-4010-ac95-bb9155944ee4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:43.863711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:43.864547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.864828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.865100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.876783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:43.878707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:43.895245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 376/742] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 14:34:43.896283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-25d1edc4-021f-4db4-9ab6-a66071fec5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:43.897978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:43.898974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:43.899942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:43.899942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:43.899942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:43.899942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:43.902382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 367/743] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:43.903603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471ee0-755f-406c-be07-2c17b588bbbb None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:43.904052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471ee0-755f-406c-be07-2c17b588bbbb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:43.904311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471ee0-755f-406c-be07-2c17b588bbbb None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:43.905750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 368/744] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:43.908587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471ee0-755f-406c-be07-2c17b588bbbb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:43.923828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.013713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268f0-ce4e-491e-929b-290c0ba26cdb None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.018379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471ee0-755f-406c-be07-2c17b588bbbb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.051101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.052071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.052491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.052929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.053781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.054495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.055338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.055617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.055840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.055946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.066688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.068170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-45d02482-8189-4c45-8356-b54963c1ab18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:44.087606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:44.088594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:44.089472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:44.089472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:44.089472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:44.089472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:44.089472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 369/745] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:44.090233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.090378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.090602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.096961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.109362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:44.110539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:44.176631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 370/746] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 14:34:44.177468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.179446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 377/747] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:34:43 2022] POST /identity/v3/services => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:44.180500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.293560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.336956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7ac5-78d9-49dd-bc95-7187c340d005 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.337687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4fb9-6fb5-4d56-a698-fe9470fa561b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.378711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.385519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.386196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.386482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.396444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.396444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:44.396444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.396444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.397274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.397274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.397274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.397274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.397554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:44.397554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.397554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.405986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 371/748] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:44.406881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.409921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 378/749] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:44.413254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.532555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6dfe-9fd4-4e1a-a91d-8a85080eca5a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.544362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d93fa-8752-4d5b-a4c3-aa30229d4497 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.570747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.571923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.572405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.572899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.584774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:44.588697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.589447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.589733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.590005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.592176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:44.595523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:44.596480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:44.597306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:44.598380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.599762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.600863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 372/750] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:44.601877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:44.620285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:44.621371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:44.622474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:44.623921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 379/751] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:44.624792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.664865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.716824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143fe0-113a-4863-a944-5797ba62e3b7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.756620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953484-d862-4ca4-8a96-82f18bcf2676 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.767094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.768182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.768669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.769116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.777140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.778826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:44.794991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:44.795931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:44.796816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:44.799103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.799543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 373/752] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:44.799998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.800457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.800824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.800989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.801750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:44.802144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.804035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.815763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 380/753] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:44.816943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:44.888219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.922174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72207-fd79-41c0-a891-899edb98c3f0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.937731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:44.943854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5bfd-784e-4146-97d3-baec7ef5bf2d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:44.970920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.972252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.972552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.972829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.973873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:44.974184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.977096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.983694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:44.984492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:44.984923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:44.985302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:44.986884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:44.987317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:44.988970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:44.997483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 374/754] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:44.998959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.004493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 381/755] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:45.005489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.118390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a2b41-2a10-4a1a-a5ce-1d495635997e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.137317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:45.138165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d80f-dbed-4a02-aa6e-fc0998c3fff6 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.158707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.159451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.159842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.160345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.161447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=5ce3d2e9dc934c84b40ceec3903fccb2) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:45.161763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.164073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.175847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 382/756] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/role_assignments?user.id=5ce3d2e9dc934c84b40ceec3903fccb2&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:45.175847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.198273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.199233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.199511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.202177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.226705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.229665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:45.265104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:45.266142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:45.267019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:45.267019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:45.267019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:45.267019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:45.268793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 375/757] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:45.273265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.333123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:45.362659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670a97-d42a-4581-8cd6-87fe494eb627 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.425389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.426670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.427160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.428974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.430645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=3b4d5d5ee8b54056b747948ee0aa4b7c) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:45.431242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.434223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1368b5b-aef3-443b-b320-e2e06ecea584 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.441931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 383/758] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/role_assignments?user.id=3b4d5d5ee8b54056b747948ee0aa4b7c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:45.470594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf2b3-f641-4d45-83e4-3639f684f547 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.509656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2b4c-7eda-4851-819d-ff475c80c017 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.510285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2b4c-7eda-4851-819d-ff475c80c017 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.510781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2b4c-7eda-4851-819d-ff475c80c017 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.512713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 384/759] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:45.527163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.527919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.528468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.533459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.534145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.534434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.534721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.535458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:45.535776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.543838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.551431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 376/760] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:45.557036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.560319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:45.562032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:45.642686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:45.652575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:45.670975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec082-5c2a-43ba-9a28-d832a082f91c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.693482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 385/761] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:45.718759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.721527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.722328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.722618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.722891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] PATH_INFO: `/v3/users/nova` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.740263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.742232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:45.766367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:45.767367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:45.768365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:45.779278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 377/762] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:45.780212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:45.875501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5281f-dcb0-44af-8ed2-cbd2da72c839 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:45.912956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:45.913935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:45.914237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:45.914569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:45.915244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:45.916689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:45.929493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:45.930472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:45.931317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 386/763] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:45.938386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.010122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07bfb7-18e6-449b-9dcb-87478a3e7caf None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.012352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.072442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6746-d58c-42bf-85f2-499659956d21 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.097657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.098402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.098723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.099025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.100149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:46.100568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.102281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.115394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.116167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.116453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.116728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.117627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:46.117938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.119485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.124982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 387/764] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:46.137731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 378/765] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:46.143273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.144630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.148154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.262694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c137f-4f64-4432-8776-61e27a2766ae None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.304646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.305322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.305602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.305879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.306599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:46.306906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.308319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.322608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 379/766] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:46.329714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.357556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fde9e-d8c7-47e0-b54c-63196382ab10 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.388189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.402241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.403042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.405652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.405652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.431391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.432892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:46.469143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:46.470100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:46.471066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:46.471066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:46.471066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:46.471066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:46.475968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 388/767] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:46.487255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.489291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.532080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd961-edf2-4e4c-b8de-01535bb7951a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.571745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.572545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.572710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.572993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.573799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] RBAC: Adding query filter params (interface=public, service_id=38294b7eb9c1418f869e8863a96d6391, region_id=RegionOne) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:46.574113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.575747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.585509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 380/768] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/endpoints?service_id=38294b7eb9c1418f869e8863a96d6391&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:46.590766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.677135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3141e-8144-496f-8457-d5b5a8d9e77d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.698230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeac978-48f2-4ec6-beee-b96e1a55e43b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.715191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.715982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.716272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.716552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.717392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:46.717703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.719207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1534d-8c9d-497f-9556-229d4cf02da7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.736984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 389/769] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:46.738618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a27e-53d8-48fa-a2ed-f22817e0d848 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.738843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a27e-53d8-48fa-a2ed-f22817e0d848 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.739138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a27e-53d8-48fa-a2ed-f22817e0d848 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.740997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.741723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 390/770] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:46.743300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9a27e-53d8-48fa-a2ed-f22817e0d848 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.748252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.757295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.757295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.757295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.757295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.757295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93383c40-2547-452d-b8b1-b1caaa9829ee None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.758866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 381/771] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:46.761339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:46.764576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.764878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.765165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.801138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:46.802290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:46.867370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9a27e-53d8-48fa-a2ed-f22817e0d848 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:46.907693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:46.908825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:46.909323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:46.909748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:46.919062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:46.921025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:46.922780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 382/772] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:46.937553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:46.938683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:46.939736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:46.946739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 391/773] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:46.948555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:46.962577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.072165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.103907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef50e0-ac9f-4640-8d36-8cc1d74c30aa None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.105404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee84c2-ceca-46c8-97fa-8e9ae37a220a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.143135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.145945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.146869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.147288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.147570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.148533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:47.148645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.148845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.149397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.149681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.149951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] PATH_INFO: `/v3/services/network` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.150299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.150607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.152252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.165620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 383/774] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:47.166910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:47.167903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:47.169102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 392/775] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:46 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:47.174170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.175390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.286056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43358cb-2faf-4dee-b16e-29288561695c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.287847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab363-8546-4cd3-a63e-c7a909769a3f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.322701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.323291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.323576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.323876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.324599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] RBAC: Adding query filter params (name=network) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:47.324909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.326769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.327993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.329111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.329627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.330116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.332039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 384/776] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:47.332738 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=8b2601ad8d254730b33d16e6ed1156cf, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.335148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.338442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.392596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.414144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.425328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 393/777] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:47 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:47.451326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a976d-a355-4702-8c15-d7ddd5e13088 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.490809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.491699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.491985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.492263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.492988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] RBAC: Adding query filter params (type=network) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:47.493294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.494668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.500637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 385/778] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:47.507118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.629824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bec7f-c203-4f04-a2a1-1b021fb1a068 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.683131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.683790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.684103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.684380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.685199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] RBAC: Adding query filter params (interface=public, service_id=28daf16f7a78477596fdb9ae59ee100f, region_id=RegionOne) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:47.685658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.687228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85266e61-cf24-49b4-9513-7297b15fe9e0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.701154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 394/779] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:34:47 2022] GET /identity/v3/endpoints?service_id=28daf16f7a78477596fdb9ae59ee100f&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:47.705903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:47.785914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb276d-7d6c-4c2a-86e1-c39bdc7dda39 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.786263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb276d-7d6c-4c2a-86e1-c39bdc7dda39 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.786629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb276d-7d6c-4c2a-86e1-c39bdc7dda39 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.788562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 395/780] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:47.794027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758c49-abbe-4a02-8605-42f93a45a592 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.794393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758c49-abbe-4a02-8605-42f93a45a592 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.794744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758c49-abbe-4a02-8605-42f93a45a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.818112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-60758c49-abbe-4a02-8605-42f93a45a592 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:47.820548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-60758c49-abbe-4a02-8605-42f93a45a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:47.827133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499ded-31f9-4465-9717-da083c49e89c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:47.844860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.869685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:47.870362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:47.870647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:47.870946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:47.872042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:47.873606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:47.879547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 386/781] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:34:47 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:47.939953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:47.953943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 396/782] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:34:47.981046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.019539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0654be-755e-4dee-8897-4b826a9e306e None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.019888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0654be-755e-4dee-8897-4b826a9e306e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.020137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0654be-755e-4dee-8897-4b826a9e306e None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.021984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 397/783] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:48.033609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.033997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.034184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.069677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:48.070901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:48.107568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fad69-e14d-4bfe-893f-f37437d188fa None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.152369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.153338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.153921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.154205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.169192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:48.172596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 398/784] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:48.177397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:48.179302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 387/785] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:48.186525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.204443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.252268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:48.299798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b825c-80d4-4760-9feb-59a72dd69b86 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.326304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:48.339229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.339950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.341922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.341922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.341922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:48.341922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:48.342356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa756e-9b86-4d74-897a-41b661e97642 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.342963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:48.352957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 399/786] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:48.359658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.408697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.409506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.409790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.410066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.441025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:48.449394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:48.450309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:48.451405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:48.463426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 388/787] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:48.471705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.609551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0180e-b4c1-47b8-a628-fa9a6e22ea4a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.626836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:48.634039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213435-1939-42b1-a600-038373e743f9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.674591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.675270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.675561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.675858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.676620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:48.676926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:48.679448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:48.690008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 389/788] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:48.699580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.701746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.713357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.713747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.713967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:48.733569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:48.734984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:48.774597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:48.775537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:48.776471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:48.776471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:48.776471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:48.776471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:48.786342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 400/789] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:48.787358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:48.859231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:48.910928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7603-ebf0-4ec5-afa2-c6835751d1a7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.979301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ac5f-3a3d-4e8e-a67b-081f15e88c19 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:48.983726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:48.984596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:48.984877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:48.985152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.005932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.007588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:49.026345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:49.027351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:49.028271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:49.028271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:49.028271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:49.028271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:49.032232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 390/790] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:49.036780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.068154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:49.069293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.069984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.070264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.070539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.071278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:49.071581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.072990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.108954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 401/791] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:49.125374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.245127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f829b5-be52-45bf-ba7a-f51714111d8a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:49.301888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:49.311606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67df0-bd50-462e-be49-dc01b8a4b54f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:49.323786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.324525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.324855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.325132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.326126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:49.326435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.327832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.347291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 391/792] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:49.354494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.372152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.373082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.373369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.373640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.391576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.393115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:49.433897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:49.434898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:49.435842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 402/793] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:49.440767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.528518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:49.532471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde9714-814c-4b45-a394-0e5bc981a74a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:49.609511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.610356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.610639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.610913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.625734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.627202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.653652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e06a6-3a18-4fbb-83e8-5b19bf4ecd42 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-1e004210-fd77-47d0-acb6-418f74b1cba5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:49.659219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:49.660168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:49.661090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 392/794] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:49.662185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795041c6-4c65-4335-a960-adbe54a82ec9 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.662185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795041c6-4c65-4335-a960-adbe54a82ec9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.662506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795041c6-4c65-4335-a960-adbe54a82ec9 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.664690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 393/795] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:49.667160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795041c6-4c65-4335-a960-adbe54a82ec9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.695290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.696487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.696969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.697434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.698500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:49.699118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.701174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c760139-53d0-4072-b16c-ee6e8ceae68f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.721453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 403/796] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:49.723051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.723636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.724144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.760401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:49.762091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:49.775003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:49.794624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795041c6-4c65-4335-a960-adbe54a82ec9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:49.826178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:49.835338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:49.836609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:49.837052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:49.837643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:49.840144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:49.840144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:49.841515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:49.848105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 404/797] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:49.849088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.862795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 394/798] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:49.868347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:49.982802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c4dc-c9a4-4164-940c-ddcc78e3603e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.001625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705147-df41-4fe4-976b-61a6d855ce8c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.020687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.022384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.023130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.023649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.034813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.037183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.041895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.045322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.046389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.046873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.047374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.060543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:50.062076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.062962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.064353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:50.064353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:50.064353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:50.064353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.065290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.067939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 405/799] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.069527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:50.091977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.093027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.093904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:50.093904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:50.093904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:50.093904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:50.096284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 395/800] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.097417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.147979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.190509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74186a0a-cc2d-4fab-a863-d1a75c81c12c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.209451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db01e-f766-4660-96fe-dea835ff7743 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.227467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.228314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.228596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.228874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.229532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.230917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.244842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.245788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 14:34:50.246622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.250274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.250274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.250495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.250697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.251458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:50.251815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.253280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303bb40-5f48-41e6-bf6c-5c14aa234553 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.253833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 406/801] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.254882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.270814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 396/802] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:50.270814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a88f-e8b0-4792-88ce-8313aa9363b2 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.270814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a88f-e8b0-4792-88ce-8313aa9363b2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.270814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a88f-e8b0-4792-88ce-8313aa9363b2 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.274207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 397/803] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:50.275025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a88f-e8b0-4792-88ce-8313aa9363b2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.320714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.370758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33cfd8-ff9f-40dd-8da4-05d96b12ad42 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.388134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.393080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a88f-e8b0-4792-88ce-8313aa9363b2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.411067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.411729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.412032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.412927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.413669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:50.413989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.415361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.427615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 407/804] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:50.429581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.429838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.430252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.430610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.430819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.431603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:50.431941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.433308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4eb2-8e84-493c-a881-3cfcad3a62c1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.438068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 398/805] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:50.439270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89dba-8620-46df-84fc-a8e5d3ed9149 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.439558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89dba-8620-46df-84fc-a8e5d3ed9149 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.439863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89dba-8620-46df-84fc-a8e5d3ed9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.456436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e0c89dba-8620-46df-84fc-a8e5d3ed9149 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:50.457652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e0c89dba-8620-46df-84fc-a8e5d3ed9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:50.523347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 399/806] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:50.524716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0a74d-2dc7-4d41-8e94-63d00814c231 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.525008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0a74d-2dc7-4d41-8e94-63d00814c231 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.525286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0a74d-2dc7-4d41-8e94-63d00814c231 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.526537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 400/807] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:50.527228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0a74d-2dc7-4d41-8e94-63d00814c231 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.542146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a093e5-c025-417c-8d95-7ffca8941cdd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.565120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.581346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.581346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.581346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.581346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.587260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.588749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:50.602793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.603931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:50.604928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.607943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 408/808] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.609255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.627855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.636000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0a74d-2dc7-4d41-8e94-63d00814c231 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.672212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.673000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.673283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.673551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.680756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.682197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-08eeca76-085b-47a3-aae9-e59e9af1bc74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:50.695727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.696849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:50.697741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 401/809] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.698632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.698632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.698632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.714262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932bd17-6902-4370-bb37-13d1511a6d33 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.715164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:50.716368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:50.752469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.753143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.753420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.753695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.754451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:50.754757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.756334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.761102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 409/810] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:50.761883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.788959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 402/811] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:50.789800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.825658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.872926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:50.880215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00ae1-763d-45d6-b476-e73033a06562 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.887928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27988d9-3fa8-4733-a714-3c953677e8f2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:50.915853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.916639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.916917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.917189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.922625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:50.923278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:50.923558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:50.923860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:50.924693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:50.925005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:50.926437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:50.927766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:50.935667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:50.936797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 410/812] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:50.937849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:50.946572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 403/813] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:50.946572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.041888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe534eb6-ba49-488b-af11-2380f338cfb3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.043447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65262a-b588-49d7-9690-a3605b7790cf None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.045048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.077049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.077704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.077984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.078255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.078460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.079048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:51.079190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.079356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.079454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.079641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.080418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.080848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.081764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.093376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 411/814] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:51.094192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.192401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47278-e1a4-4a56-a7cd-d7b0fb2df90a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.224784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.226403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.226684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.226959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] PATH_INFO: `/v3/services/network` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.227649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.229042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:51.241649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:51.242908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:51.243780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 412/815] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:51.244680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.250288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.255985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 404/816] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:34:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:51.257322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.279992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.372511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ca59b-6998-40f7-b703-60bfcb9e7d39 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.381845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af15ed-14ab-46c0-bdb0-042108525908 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.414716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.415397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.415684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.415993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.416845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:51.417151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.418536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.422952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.423881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.424612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.424612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/5ce3d2e9dc934c84b40ceec3903fccb2/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.429173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 413/817] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:51.430269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.442664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=5ce3d2e9dc934c84b40ceec3903fccb2, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.444121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.520766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 405/818] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:51 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/5ce3d2e9dc934c84b40ceec3903fccb2/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:51.527537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.530096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.539225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cdde-45f5-4818-aece-97430dbeb3b2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.586786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.588293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.588820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.589335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/3b4d5d5ee8b54056b747948ee0aa4b7c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.591970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=3b4d5d5ee8b54056b747948ee0aa4b7c, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.593890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.606472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.664576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bb834-a877-4b96-aafb-b3e7861f64fb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.693390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 414/819] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:34:51 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/3b4d5d5ee8b54056b747948ee0aa4b7c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:34:51.695444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.723939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.724869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.725836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.726112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.726903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:51.727208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.728696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.734222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 406/820] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:51.741480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.868233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0ca1-ff3a-4f7f-afb8-9ff4b1085b53 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.888499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61717-250d-465f-bd19-79fa640da8f1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:51.910478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:51.939194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.940432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.940850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.941293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.949057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:51.950009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:51.950738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:51.951155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:51.952105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] RBAC: Adding query filter params (type=network) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:51.952555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.954275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.960907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:51.962557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:51.967848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 407/821] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:51.970516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:51.988855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:51.989968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:51.991025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:51.991025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:51.991025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:51.991025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:51.992911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 415/822] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:51.999197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:52.002216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:52.114892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241217d1-001a-42c7-a56a-dd1aa49ad92f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:52.123344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28f66-28e5-4433-8118-08f264940b35 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:52.157020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:52.157837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:52.158280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:52.158733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:52.159712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:52.161154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:52.169441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:52.170541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:52.171432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:52.172116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:52.172884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:52.173197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:52.174580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:52.188273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 416/823] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:52.197037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:52.252709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 408/824] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:34:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:52.287130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:52.340267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b458c-15fb-435b-8426-01414ee03702 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:52.398169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:52.399207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:52.399621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:52.400028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:52.415561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:52.417302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:52.440735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:52.441937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:34:52.443126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:52.454054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 417/825] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:34:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:52.454249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:52.504092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:52.586530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0b773-5107-45e7-831f-cbe5c23acd59 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:52.623725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:52.624590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:52.624976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:52.625354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:52.626327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:52.626738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:52.628304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:52.652146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 409/826] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:52.654039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:52.779141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e29f2-34ce-4883-94ee-1c0ff682e149 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:52.804414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:52.821135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:52.821964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:52.822347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:52.822719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:52.904395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:52.906061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.016535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 418/827] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:34:53.022797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.128914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:53.132782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286cd3-fca0-47a4-b927-8ab4caa059d9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.172484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.173286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.173564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.173836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.185764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.187198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:53.205402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:53.207432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:53.210246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:53.210246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:53.210246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:53.210246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:53.210246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 410/828] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:53.215837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.232696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:53.319098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609756-e8a5-4f17-8fa4-9c75e4793287 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.356166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.356838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.357120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.357394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.358121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:53.358425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.359825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.372442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 419/829] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:53.377621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.482760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743592ab-978a-465b-ad4e-0e0c584467df None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.517116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.517908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.518184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.518452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.526260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.527708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.534347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-25a7e6a7-7a65-4259-a938-5052b20be6d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:53.543407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:53.545425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:53.547538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 411/830] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:53.552870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.641979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:53.655555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b7b7-ce01-40f3-b8d1-d8313cdb3c9b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.655881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b7b7-ce01-40f3-b8d1-d8313cdb3c9b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.656991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b7b7-ce01-40f3-b8d1-d8313cdb3c9b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.658439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 412/831] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:34:53.666107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.666107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.666107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.673516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f963400-d3ad-41aa-802c-ea99460fb426 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.684865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:53.686393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:53.719898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.720563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.720936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.721212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.722001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:53.722332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.724012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.739275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 420/832] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:53.745737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.777247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 413/833] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:34:53.800302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:53.856001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb74c36-b58a-4927-8d62-8a3afea3f4f7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.899274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.900356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.900356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.900558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.901318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:53.901624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.903083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382084f-7878-456c-95f9-bbafda30e1bf None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.914793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaae1e7-3bf4-49fd-bdad-7a4889088645 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:53.917920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 421/834] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:53.956519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:53.963751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:53.968995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.968995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.968995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.968995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:53.968995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:53.983249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:53.984431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:34:53.985342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:53.988516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 414/835] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:53.995093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec58f-d696-44b5-aa10-d7971e7d2089 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:53.995387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec58f-d696-44b5-aa10-d7971e7d2089 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:53.995592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec58f-d696-44b5-aa10-d7971e7d2089 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:53.995954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.001293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 422/836] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:54.003118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fac11-34e0-4356-80e8-6889077e136c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.003411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fac11-34e0-4356-80e8-6889077e136c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.003697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fac11-34e0-4356-80e8-6889077e136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.010714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.030155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-555fac11-34e0-4356-80e8-6889077e136c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:54.031671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-555fac11-34e0-4356-80e8-6889077e136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:54.119718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 423/837] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:34:54.145898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fac11-34e0-4356-80e8-6889077e136c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.259062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8c875-2504-4d5f-aff9-f3d3c40a7d1f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.283246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fac11-34e0-4356-80e8-6889077e136c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.305232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.305905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.306183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.306456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.307512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:54.307840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:54.309238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463faac-aab8-4ef8-af36-eee86f50c02a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:54.316031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 415/838] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:54.317952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a5aa-c6a0-4406-acea-de364ca9a4a6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.318245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a5aa-c6a0-4406-acea-de364ca9a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.318514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a5aa-c6a0-4406-acea-de364ca9a4a6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.320937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 416/839] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:54.322696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56a5aa-c6a0-4406-acea-de364ca9a4a6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.326493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.328961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.329773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.330053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.330324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.342768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-eedd03ae-4fa0-4410-b8a6-73963ce188cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:54.351535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:54.352575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:34:54.353424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:54.356238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 424/840] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:54.357722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.358010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.358290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.376036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:54.377433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:54.395857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.445467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56a5aa-c6a0-4406-acea-de364ca9a4a6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.459837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 425/841] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:54.459837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.494530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.495598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.495598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.495824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.496554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:54.496858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:54.498293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:54.503116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 417/842] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:54.504038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.592121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b5f3-0a7e-475a-a14e-6fcb2bb24bdd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.626530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.626881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede26be-44b5-4133-9ba7-6e96c5323b0b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.641888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.642892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.643170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.643862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.645025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:54.645338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:54.648013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:54.654339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.659894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 426/843] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:54.667961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.674039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.674747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.675032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.675306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.691094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:54.699617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:54.700888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:54.703897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 418/844] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:54.707187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.821847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48933cdf-e14f-4875-b660-108060fef174 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.825718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d984-25f2-4137-b55a-134ea7d3cdd6 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:54.859272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.859900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.860187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.860463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.861225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:54.861547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:54.862931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:54.873722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:54.875028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:54.875569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:54.876105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:54.877474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 419/845] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:54.878382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.892038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:54.894735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:54.919394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:54.920832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:54.921734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:54.921734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:54.921734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:54.921734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:54.924064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 427/846] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:54.927869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:54.934979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.969401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:54.996581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4097d-7c9c-489e-98d4-fe19c5f162a8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.033607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d41-6be0-4cfd-96b3-fffecff9adfb None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.034979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.036028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.036487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.036961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.049165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.050875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.071708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.072403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.072683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.072957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:55.073133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:55.074111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:55.074990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:55.074990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:55.074990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:55.074990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:55.075221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:55.075221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.075952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.082079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 420/847] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:55.083224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.091850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 428/848] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:55.096522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.189434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.197487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4b5de-9319-40ae-bbfa-c0477a17586c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.206645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.215003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c3da-fe2e-480b-a297-cfa3d63ceeba None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.244931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.245666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.245956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.246231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.247182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:55.247497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.249534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.256942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.258327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.258805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.259266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.265057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 421/849] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:55.269092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.270615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.271048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:55.288530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:55.289541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:34:55.290548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:55.297286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 429/850] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:55.298731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.379860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08122-4323-4314-a974-e4a7f04a76f7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.412699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf09a-58e4-4735-8cb4-d96ae8bc09c1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.416470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.417344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.417702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.418044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.425743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.427186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:34:55.442634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:55.444598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 14:34:55.446057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:55.451928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 422/851] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:55.452861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.457102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.457946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.458391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.458826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.460173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:55.460717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.462437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.471494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.484327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 430/852] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:55.489726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.507003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.560271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f71f1-b7be-49ae-9d79-55ae57ed79ad None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.597355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.598435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.598961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.599435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.600663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:55.600787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753dd9-4f1d-40ae-b901-ced6c27937b4 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.601483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.603124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.626988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 423/853] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:55.628293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.642078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.642729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.643060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.643322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.710759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.719594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.721095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.738179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.744436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb73e0-774d-4556-8cb0-0001625c5b4a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.780740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.781723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.782360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.782856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:55.837238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 431/854] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 14:34:55.838681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.857037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:55.858828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:55.936952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.947916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ec3fb-bad4-4fe3-8cde-66f850546b80 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:55.963372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:55.970792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 424/855] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:34:55.971986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:55.990136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:55.991255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:55.991768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:55.992334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.011833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.011833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:56.027196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:56.028339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:56.029437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:56.029437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:56.029437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:56.029437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:56.033141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 432/856] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:56.034456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.095455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5a58-c5e2-47d6-9ef8-c69acdabee6f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.134805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.135623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.136041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.136321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.144183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4b17-5a01-4d9d-b34c-8d9f33f5d5b9 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.149643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.151145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:34:56.171921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:56.174000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:56.175156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:34:56.175156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:34:56.175156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:34:56.175156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:56.175156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 425/857] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:56.181660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.184818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.185562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.185919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.186296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.187090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:56.187473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.188953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.207285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 433/858] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:56.208611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.213277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.237442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.291331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51613-0ca3-4c91-818b-d2605b37466e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.319633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1927-5693-4d77-bf5b-036ac162ebaf None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.328932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.329596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.329881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.330150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.330876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:56.331178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.332560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5caae9-49d6-4889-b151-e3aea65b8c3f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.345300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 426/859] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:34:56.346695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05b04-c1fd-42bd-8051-36d237b3797b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.346984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05b04-c1fd-42bd-8051-36d237b3797b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.347260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05b04-c1fd-42bd-8051-36d237b3797b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.348755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 427/860] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:56.353284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05b04-c1fd-42bd-8051-36d237b3797b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.363346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.364168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.364447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.364776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.372647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.374089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-b3caf88f-6cae-46fe-b3e1-46036d52577f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:56.388586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:56.389523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:56.390495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:34:56.394678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 434/861] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:34:56.396035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.396354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.396622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.417411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:56.419011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:56.449131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.465786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05b04-c1fd-42bd-8051-36d237b3797b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.500083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 435/862] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:56.500083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.507917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.512341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.512743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.513129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.523192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.524713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.529706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:34:56.540178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:56.545683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 428/863] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:56.546728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.627947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18106e-48eb-4e4a-881e-8b96268206a9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.659614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed1d1-bf5a-4287-9441-204775266f3f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.673191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.673864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.674148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.674425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.675219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:56.675530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.677010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.690074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 436/864] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:56.690887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.706421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.707641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.708137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.708590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.709464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.711153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:56.724605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:56.726213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:34:56.727146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:56.734934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 429/865] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:56.735280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.749299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.786109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:56.814022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b063-eb01-4e31-8317-d65a6f2cdaa3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.845041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666d4b-f2fc-4da3-81a7-f62612f37b6d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.848934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.849592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.849870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.850924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.852113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:56.852470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.854276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.866555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 437/866] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:56.867344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.879671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:56.880348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.880628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.880900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.882273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=5ce3d2e9dc934c84b40ceec3903fccb2) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:56.882604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:56.884053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bad1b-6a10-44e8-9c31-63f09e4baa63 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:56.889970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 430/867] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/role_assignments?user.id=5ce3d2e9dc934c84b40ceec3903fccb2&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:56.891172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbb95-d5e0-4e78-9f90-5cd6767c6731 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:56.891463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbb95-d5e0-4e78-9f90-5cd6767c6731 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:56.891736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbb95-d5e0-4e78-9f90-5cd6767c6731 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:56.895926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 431/868] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:56.895926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bbb95-d5e0-4e78-9f90-5cd6767c6731 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:56.993884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f49f4-e217-4d05-afe7-e9d4f89b7406 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:56.996088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:57.024110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bbb95-d5e0-4e78-9f90-5cd6767c6731 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:57.032866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:57.033550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:57.033836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:57.034138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:57.034828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:57.035134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:57.036633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73670b5-e0aa-4928-aed8-fb96e99e0271 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:57.039105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:57.043157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 438/869] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:57.049049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:57.049332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:57.054816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:57.066416 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:57.066841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:57.067127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:57.067432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:57.071590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:57.071751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=3b4d5d5ee8b54056b747948ee0aa4b7c) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:57.071751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:57.071935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:57.072021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:57.078691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 432/870] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:34:56 2022] GET /identity/v3/role_assignments?user.id=3b4d5d5ee8b54056b747948ee0aa4b7c&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:57.079883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:57.181060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 439/871] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:57.206727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:57.220329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b570-5a62-44f3-a0c0-b8d3362ed53e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:57.263083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:57.263757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:57.264076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:57.264478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:57.265202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:57.265508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:57.266902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d904f-6ab5-4299-9e73-093288507028 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:57.275546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 433/872] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:34:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:57.322407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f543f-e2af-40f1-955d-c28c7ab80b9f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:57.359483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:57.366296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:57.372958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:57.372958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:57.372958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:57.372958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:57.372958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0b925-2c2c-41b4-9896-5e46fa0502f7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:57.456726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 440/873] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:34:57 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:34:59.196460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25482334-06c8-4ca2-920d-24d27e5bc334 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.196978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25482334-06c8-4ca2-920d-24d27e5bc334 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.197164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25482334-06c8-4ca2-920d-24d27e5bc334 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.198711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 434/874] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:59.204460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155686-bc11-4fe7-81f4-1e797930ba04 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.204887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155686-bc11-4fe7-81f4-1e797930ba04 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.204997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155686-bc11-4fe7-81f4-1e797930ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.222706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f8155686-bc11-4fe7-81f4-1e797930ba04 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:59.223930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f8155686-bc11-4fe7-81f4-1e797930ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:59.303171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 441/875] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:34:59.326881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25482334-06c8-4ca2-920d-24d27e5bc334 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.330078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:59.370197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad046d-0e33-4c47-8236-780363e3fb52 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.370483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad046d-0e33-4c47-8236-780363e3fb52 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.370758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad046d-0e33-4c47-8236-780363e3fb52 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.372391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 442/876] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:59.377473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73fb6-9eef-44c4-a124-7bdbd9eb1b51 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.377763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73fb6-9eef-44c4-a124-7bdbd9eb1b51 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.378042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73fb6-9eef-44c4-a124-7bdbd9eb1b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.400793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8ba73fb6-9eef-44c4-a124-7bdbd9eb1b51 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:59.402708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8ba73fb6-9eef-44c4-a124-7bdbd9eb1b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:59.460093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25482334-06c8-4ca2-920d-24d27e5bc334 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:59.495928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:59.496753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.497038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.497309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.500117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 443/877] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:34:59.501321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2ae2-6b6b-4863-bb8b-8b2df1b13c38 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.501629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2ae2-6b6b-4863-bb8b-8b2df1b13c38 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.501919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2ae2-6b6b-4863-bb8b-8b2df1b13c38 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.503367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 444/878] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:59.509394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.510030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.511063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.518212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:34:59.529134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:59.530116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:59.531068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 435/879] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:59.531763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.538499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:34:59.540024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:34:59.587961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:59.595522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:59.615632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 445/880] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:34:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:34:59.617596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.639626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ab80-f097-401b-a4a5-882fe9d2d32d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:59.682551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:59.683359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.683660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.683972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.684632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:59.685984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:34:59.698154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:34:59.699214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:34:59.700093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 436/881] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:34:59.701213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.747236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c313-6c41-49a2-ba27-e277fe7cf029 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:59.781256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:59.781921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.782197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.782466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.783233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:59.783532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:59.784932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:59.793927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 446/882] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:59.794718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.808719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afc88-15d8-43a0-b3d5-0b273ba4cbfc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:59.835268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:59.835837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:34:59.844346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:59.845010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.845293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.845602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.846396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:59.847758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:59.895331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfab4-6e50-486d-93f8-f31136136fea None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:34:59.928758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:34:59.929416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.929700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.930007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.930727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:34:59.931029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:34:59.932480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a54376-1cdb-4bdb-8ccd-cc33eaa03c03 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:34:59.937097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 447/883] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:34:59.938283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174843-952c-462a-84b1-6dd649dce75f None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:34:59.938568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174843-952c-462a-84b1-6dd649dce75f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:34:59.944535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174843-952c-462a-84b1-6dd649dce75f None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:34:59.944535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 448/884] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:34:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:34:59.944535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174843-952c-462a-84b1-6dd649dce75f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:34:59.972180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 437/885] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:34:59 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:34:59.973178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.064463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.070695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174843-952c-462a-84b1-6dd649dce75f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.112600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.113622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.114027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.114437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.115374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4368-f683-437a-bd3b-d44f75160f5a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.128417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.130241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-394f28a9-e889-4fa9-84f4-a75b4de7ad15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:00.150744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:00.151703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:00.152644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:00.152644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:00.152644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:00.152644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:00.152644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 449/886] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:00.153257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.153548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.153834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.155022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.155697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.156033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.156308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.157027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:00.157338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.158781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.165050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 438/887] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:34:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:00.165876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.173994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:00.175301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:00.249818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.272950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 450/888] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:00.300102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.326138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d6c1-e810-44af-91b5-7b5d4a9c9416 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.368671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.370485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.370485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.370485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.370748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:00.371569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.372343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.391907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 439/889] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:00.394446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.420779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.448759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3dacc-69bb-4955-8861-31d6e0d26024 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.493310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.494495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.494973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.495436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.496339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.497911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:00.511269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:00.512548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:00.513436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:00.516230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 451/890] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:00.522667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.524360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14523-686d-4574-8418-5bb4cbbff0bb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.536896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.563610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.564723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.564999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.565272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.574069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.575939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:00.594524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:00.595499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:00.596463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:00.600689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 440/891] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:00.602363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.666628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137a19-7503-4120-a9c4-0fe104ec1134 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.705835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.706884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.707387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.707905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.708811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:00.709311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.711283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.716949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 452/892] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:00.722218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.725817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba1fe-d7ff-42be-a8d9-0931ccaca6bc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.747320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.771250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.772654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.773208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.773684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.774797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:00.775364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.798100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 441/893] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:00.806847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.835249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:00.849849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686537c-272a-4cae-a16e-b1da8e235606 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.884959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.885258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.885527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.885801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.886507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:00.886812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:00.888218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:00.894110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 453/894] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:00.900135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:00.920474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df655-dcc0-4c9d-ad5c-e88126f789dc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:00.959170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:00.960559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:00.961153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:00.961687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:00.997438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:01.030538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b276c6-c1e4-46dd-a466-15d669a4da4c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.052907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.054960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.079399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.080105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.080384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.080656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.081440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] RBAC: Adding query filter params (interface=public, service_id=22821e25794142b49585253a31f618c3, region_id=RegionOne) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:01.081748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.083268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.087570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:01.089759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 454/895] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/endpoints?service_id=22821e25794142b49585253a31f618c3&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:01.094721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.182203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 442/896] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:01.187273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.223828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75269-2835-435c-a861-c91492ffaee2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.265422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.266467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.266953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.267429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.268371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.270090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.273608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:01.285371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 455/897] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:35:01.297249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4874e-2a0c-450c-a392-c5c9a1603699 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.330726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:01.340363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.341210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.341497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.341780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.355037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.356545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:01.376644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:01.377685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:01.378574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:01.378574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:01.378574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:01.378574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:01.378574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 443/898] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:01.384027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.503487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a978-e1e2-47ce-89dd-e580ca0fdb43 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.541021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.541709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.542004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.542277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.543007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:01.543331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.544718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.557777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 456/899] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:01.563323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.670249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38837-7827-4d8f-a535-2e8b50a1dfed None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.706167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.706958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.707235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.707505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.715248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.716713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:01.731226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:01.732195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:01.733080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 444/900] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:01.738244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.810638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:01.857746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc331b-76f2-49b0-bcea-4e9459dc6404 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:01.899143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:01.900206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:01.900718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:01.901207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:01.902208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:01.902709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:01.904530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a834-e6db-4e27-863c-d71b74b11a0b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:01.918235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 457/901] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:01.926666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:01.968897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:02.032390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12417c4-7f5d-4655-9a9d-d0f6d9f75db0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:02.073146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:02.073727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.074070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.074345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.075451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] RBAC: Adding query filter params (role.id=5e981a2bb98943a68625fe1ad6bb9585, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=5ce3d2e9dc934c84b40ceec3903fccb2) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:02.076053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:02.077510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8882d-138e-4b4b-8f6a-8e3bf0d20eaf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:02.084315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 445/902] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:01 2022] GET /identity/v3/role_assignments?user.id=5ce3d2e9dc934c84b40ceec3903fccb2&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=5e981a2bb98943a68625fe1ad6bb9585 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:02.252161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acbdb-379f-4d67-950d-308421902d03 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.252686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acbdb-379f-4d67-950d-308421902d03 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.253144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acbdb-379f-4d67-950d-308421902d03 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.254677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 458/903] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:02.261643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97454-69b0-4ba0-b76c-f6aebb9e7397 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.261942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97454-69b0-4ba0-b76c-f6aebb9e7397 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.262223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97454-69b0-4ba0-b76c-f6aebb9e7397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.280619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5af97454-69b0-4ba0-b76c-f6aebb9e7397 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:02.282038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5af97454-69b0-4ba0-b76c-f6aebb9e7397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:02.360316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 446/904] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:02.383521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677acbdb-379f-4d67-950d-308421902d03 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:02.477143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07615c4-5871-43ab-8ba8-6c2e3334ad2f None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.477502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07615c4-5871-43ab-8ba8-6c2e3334ad2f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.477753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07615c4-5871-43ab-8ba8-6c2e3334ad2f None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.479442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 447/905] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:02.485947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230767d3-c124-4e54-989f-db25055408d7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.486257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230767d3-c124-4e54-989f-db25055408d7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.486536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230767d3-c124-4e54-989f-db25055408d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.510208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-230767d3-c124-4e54-989f-db25055408d7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:02.511760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-230767d3-c124-4e54-989f-db25055408d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:02.519446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677acbdb-379f-4d67-950d-308421902d03 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:02.544519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:02.550869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:02.569219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:02.570161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.570440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.570940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.571629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:02.573306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:02.588516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:02.589555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:02.590411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 459/906] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jun 15 14:35:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:02.600991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:02.606725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 448/907] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:02.630197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230767d3-c124-4e54-989f-db25055408d7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:02.724258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592176-6e8c-4a54-a86e-9b269eab6ccf None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:02.765560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230767d3-c124-4e54-989f-db25055408d7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:02.778617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:02.779691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.780198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.780628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.781512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:02.781969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:02.783637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:02.790401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 460/908] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:02.796663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:02.813568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:02.814679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.815078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.815451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.816333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:02.818692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:02.857687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:02.903970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 449/909] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:35:02 2022] POST /identity/v3/services => generated 241 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:02.920113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411fad-6f91-45cf-a166-9706c88a3522 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:02.966499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:02.967557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:02.968131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:02.968605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:02.969571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:02.970121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:02.971774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:02.978981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 461/910] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:02.984582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:03.014897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:03.097384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c1fe-33d8-4c19-b170-dd426bada60c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:03.133577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:03.134242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:03.134524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:03.134799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:03.135597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] RBAC: Adding query filter params (interface=public, service_id=042a364280714090b47885eeaefd0089, region_id=RegionOne) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:03.135938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:03.137310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b702c-caa4-4379-95c1-1d2075836494 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:03.143079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 450/911] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:35:02 2022] GET /identity/v3/endpoints?service_id=042a364280714090b47885eeaefd0089&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:03.148605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:03.259875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922d19-cbe4-4b11-ae5d-0fe34297dcaa None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:03.269350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:03.296501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:03.297173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:03.297451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:03.297723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:03.298408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:03.299799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dac67-53b8-4833-b781-7299020db32f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:03.307124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 462/912] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:03 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:35:03.651783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc8253-f8e6-471a-802c-9638d2235f57 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:03.652369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc8253-f8e6-471a-802c-9638d2235f57 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:03.652369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc8253-f8e6-471a-802c-9638d2235f57 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:03.654031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 451/913] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:03.659946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:03.660871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:03.661372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:03.680094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:03.681618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:03.769940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 463/914] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:03.793837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc8253-f8e6-471a-802c-9638d2235f57 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:03.893167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:03.919068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc8253-f8e6-471a-802c-9638d2235f57 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:03.946765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:03.947571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:03.947871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:03.948147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:03.948807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:03.950208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:03.963698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:03.964754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:03.965611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 452/915] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:03.973197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.083047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42823afb-ef3e-467e-9a08-58200ac3b868 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.085268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.119946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a941-8823-404e-b309-0559847690b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.120621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a941-8823-404e-b309-0559847690b4 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.120897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a941-8823-404e-b309-0559847690b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.121168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a941-8823-404e-b309-0559847690b4 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.121886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a941-8823-404e-b309-0559847690b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:04.122188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a941-8823-404e-b309-0559847690b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:04.123733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a941-8823-404e-b309-0559847690b4 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:04.130060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 464/916] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:04.136619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.246762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081348-deab-4a39-880e-b8782acc9730 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.286090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.286749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.287025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.287299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.288163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:04.288535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:04.289906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aaa0f-42ba-4065-8e56-4d79d40be519 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:04.295353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 453/917] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jun 15 14:35:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:04.300820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a941-8823-404e-b309-0559847690b4 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.310846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33e46-c88e-4cfc-be4f-6893d8ab9ba7 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.311159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33e46-c88e-4cfc-be4f-6893d8ab9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.311423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33e46-c88e-4cfc-be4f-6893d8ab9ba7 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.313057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 454/918] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:04.317878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.318167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.318449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.336338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:04.337531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:04.349081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.415063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 455/919] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:04.418633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a941-8823-404e-b309-0559847690b4 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.437439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.460521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.461365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.461760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.462130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.462977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:04.464682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:04.551487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7367f-2e83-4c70-af9d-f9898e164075 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.560124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 465/920] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:04.597955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.598779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.599056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.599324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.612255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:04.620853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:04.621869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:04.622715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 456/921] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:35:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:04.630428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.660999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.754846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375e5b-7cb7-435e-b11f-ce829e4287d3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.792140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.793049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.793561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.793990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.794923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:04.795390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:04.796966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:04.807187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 466/922] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:35:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:04.812908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:04.816062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.921927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeaaf-6235-4b03-8865-18d77e375607 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:04.958629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:04.959822 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:04.960294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:04.960782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:04.972615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:04.974317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:04.994340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:04.995386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:04.996324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:04.996324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:04.996324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:04.996324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:04.998352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 457/923] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:05.004210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.106012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.117581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101e05-d9c4-458a-895f-979c42dea2ce None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.155152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.156240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.157028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.157448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.158351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:05.158824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.160412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd4244-0d4b-4544-a391-2f263b62846e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.174272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 467/924] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:05.180273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.242914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.272529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe0a9-ceb7-4f79-b5a3-9ca1da1e9bc8 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.273360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe0a9-ceb7-4f79-b5a3-9ca1da1e9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.274023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe0a9-ceb7-4f79-b5a3-9ca1da1e9bc8 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.275921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 468/925] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:05.283399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.283685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.283994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.293811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872c089-119e-467a-9b39-a2274a906e31 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.301881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:05.303072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:05.336801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.337638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.337925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.338203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.347270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.348761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:05.364718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:05.366312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:05.367269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 458/926] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:05.372123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.383325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 469/927] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:05.407188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.499053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f80ec-09c2-4c2a-b5d1-22e5b3f219b0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.499833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.518208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.527553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745825-3eab-4c89-a41b-b37711c4982e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.543541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.544248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.544530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.544806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.545647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:05.545956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.547394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b3cb-9723-4145-8c95-04ab40b91204 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.565471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.571899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 459/928] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:05.572046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.572046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.572046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.572270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bb4-a722-400e-8413-7fef58e49bd3 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.572350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.572422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bb4-a722-400e-8413-7fef58e49bd3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.572422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bb4-a722-400e-8413-7fef58e49bd3 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.572554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.572625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 460/929] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:05.572625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156bb4-a722-400e-8413-7fef58e49bd3 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-1627b9ba-f235-4b51-b751-a3b7de7cd29c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:05.588875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:05.589909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:05.590731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 470/930] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:05.592086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.592086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.592320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.609320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:05.610522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:05.675683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 471/931] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:05.676469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.698129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156bb4-a722-400e-8413-7fef58e49bd3 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.741764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.742684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.742966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.743238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.753852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.755387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.757684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:05.775199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:05.776227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:05.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:05.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:05.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:05.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:05.777118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 461/932] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:05.777987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.800867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3393a1-7d85-40cb-9411-63463ea587b2 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.805535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:05.837970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.838699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.838980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.839247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.839987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:05.840298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.841674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.847071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 472/933] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:05.848034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.889935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f85b1-ed14-4bca-8366-a0d4dff4ef73 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:05.926394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:05.927127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:05.927411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:05.927685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:05.928414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:05.929833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:05.942482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:05.943421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:05.944653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 462/934] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:05.945510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:05.960902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8dc3-050c-4318-9e39-f9e49ed4be4d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.000935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.007750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.008630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.008910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.009183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.010043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.010349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.011743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.026107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 473/935] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.026107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.044411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.057035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf75af-a014-499e-aeac-5689631c974f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.096221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.096888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.097182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.097463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.102525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.102525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.102525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.106325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 463/936] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.107441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.157222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f91b-d3d1-4009-aba9-99e36d6b9018 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.195107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.195703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.196014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.196290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.196999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.197304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.198682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.204031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 474/937] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.209253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.224769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d109-8abf-4977-ac11-defdfb21dba9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.261410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.262218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.262505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.262786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.269892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.271335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.272739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:06.286867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:06.294112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 464/938] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:06.295168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.311791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.330292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dc79d-8891-48d5-9044-9f29349a0d23 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.365973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.366634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.366915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.367193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.368014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] RBAC: Adding query filter params (interface=public, service_id=3329616f88da44578caf56f261295e85, region_id=RegionOne) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.368324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.369703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.375265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 475/939] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/endpoints?service_id=3329616f88da44578caf56f261295e85&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.376150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.406375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49315737-0692-479f-9daf-89bf92f6fc5a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.442731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.443539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.444477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.445003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.445972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.446305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.447874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.453479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 465/940] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.454367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.497785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb3ba-a3f5-4a16-b4fb-6a56cce82c01 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.519430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.534089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.534754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.535036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.535311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.536135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:06.536440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.538007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.538599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.557862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 476/941] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:06.557862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.567189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd286f-4e1d-49e2-ac19-dcb56ff0edba None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.611830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.612502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.612789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.613068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.613755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.615128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.625428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 466/942] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:06 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:35:06.625428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:06.698574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696bf9c-f030-4753-aa1a-9e7ad0ec3172 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.743010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.743890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.744593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.744593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.745486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.747076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960d44-03c6-4615-a69d-bf1ee1084609 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.774839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4cc3-2415-4ca4-a227-96816a4ac757 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:06.817588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:06.817936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.818160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.818432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/5ce3d2e9dc934c84b40ceec3903fccb2/roles/5e981a2bb98943a68625fe1ad6bb9585` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.820786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=5ce3d2e9dc934c84b40ceec3903fccb2, role_id=5e981a2bb98943a68625fe1ad6bb9585)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:06.822207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f448-8f1b-4fd0-86c7-0716c1a307f4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:06.859611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 477/943] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:06.917533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.924594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 467/944] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:35:06 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/5ce3d2e9dc934c84b40ceec3903fccb2/roles/5e981a2bb98943a68625fe1ad6bb9585 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:35:06.965040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837ecb1-36a2-4b3b-974a-d20836358a65 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.965365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837ecb1-36a2-4b3b-974a-d20836358a65 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.965803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837ecb1-36a2-4b3b-974a-d20836358a65 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:06.968294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 478/945] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:06.977278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c87855-581f-480b-ad47-620b265261a1 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:06.977739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c87855-581f-480b-ad47-620b265261a1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:06.978182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c87855-581f-480b-ad47-620b265261a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:07.008694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-64c87855-581f-480b-ad47-620b265261a1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:07.010896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-64c87855-581f-480b-ad47-620b265261a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:07.138522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 468/946] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:07.166771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837ecb1-36a2-4b3b-974a-d20836358a65 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:07.223366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:07.306679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837ecb1-36a2-4b3b-974a-d20836358a65 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:07.348755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:07.349416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:07.349734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:07.349961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:07.351682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:07.353185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:07.354646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING keystone.server.flask.common [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 14:35:07.406273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.sql.core [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 14:35:07.406273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 14:35:07.406273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [parameters: {'id': '9f1176b574f045488ec0253eb5849236', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 14:35:07.406273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87017) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f1176b574f045488ec0253eb5849236.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f1176b574f045488ec0253eb5849236. Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:35:07.425651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application result.read() Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 14:35:07.426544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application yield resource Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise self.value Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application session.commit() Jun 15 14:35:07.427899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self.session.flush() Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application compat.raise_( Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 14:35:07.428990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 14:35:07.429914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application result.read() Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:35:07.430717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [parameters: {'id': '9f1176b574f045488ec0253eb5849236', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:07.431578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:07.434196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f1176b574f045488ec0253eb5849236. Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:07.436320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 479/947] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Jun 15 14:35:07 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:07.437528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c87855-581f-480b-ad47-620b265261a1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:07.550661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c87855-581f-480b-ad47-620b265261a1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:07.585703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:07.595980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:07.597201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:07.602554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:07.602554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:07.606327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:07.608032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-7dfb9fb5-5933-45a1-b0ce-c97d35801772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:07.624632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:07.625567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:07.626452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:07.628666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 469/948] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:07.638334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:07.752406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:07.758799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcac1-1d0a-42f8-bdc4-e3e0632344eb None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:07.799290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:07.800548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:07.801128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:07.801720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:07.803103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:07.804496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:07.806982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f023cf-b89c-4c97-a6a2-7b2f9391d1f1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:07.836336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 480/949] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:08.977518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b61b5-e73f-4e51-9ae7-aba9c188589b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:08.978500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b61b5-e73f-4e51-9ae7-aba9c188589b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:08.978976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b61b5-e73f-4e51-9ae7-aba9c188589b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:08.980918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 470/950] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:08.985922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:08.986327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:08.986495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.004699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:09.006224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:09.080558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 481/951] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:09.103744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b61b5-e73f-4e51-9ae7-aba9c188589b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.218320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b61b5-e73f-4e51-9ae7-aba9c188589b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.257069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.257844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.258201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.258481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.259225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.260749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8b90c690-f22e-465c-b024-65605c03a9f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:09.275415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:09.276637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.277946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 471/952] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:09.283251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.328771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5a2c-f545-4a58-bd83-917a096547f3 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.329503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5a2c-f545-4a58-bd83-917a096547f3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.329846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5a2c-f545-4a58-bd83-917a096547f3 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.331635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 472/953] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:09.336753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842f55-cde4-42c2-970d-a2afab44e7c2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.337161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842f55-cde4-42c2-970d-a2afab44e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.337949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842f55-cde4-42c2-970d-a2afab44e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.360777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-86842f55-cde4-42c2-970d-a2afab44e7c2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:09.362399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-86842f55-cde4-42c2-970d-a2afab44e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:09.379685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.407154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35b73-1ad3-4609-ba5e-a219b285e7a6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.432017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.453731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.454505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.454847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.455213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.456088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:09.456289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 473/954] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:09.456610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.457820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f210bb-bd53-4c80-a38c-efb7c91a5115 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.458075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614912ec-87a6-4afc-bf9c-85856b3015e7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.458176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f210bb-bd53-4c80-a38c-efb7c91a5115 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.458402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f210bb-bd53-4c80-a38c-efb7c91a5115 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.460106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 474/955] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:09.463863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 482/956] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:09.469406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f210bb-bd53-4c80-a38c-efb7c91a5115 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.470962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.471249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.471520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.489719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:09.491472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:09.572073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 483/957] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:09.572073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.593472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f210bb-bd53-4c80-a38c-efb7c91a5115 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.628984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.629648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.629930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.630201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.630910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:09.631214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.632801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.642905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 475/958] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:09.642905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.664313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.688726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11826e-b239-4bb8-8aca-acbe39ab0416 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.690808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.730402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.733677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.733677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.733677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.743781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:09.752223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:09.753359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:09.754328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 484/959] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:09.755115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.768646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1640-9a83-4b4c-8162-5b5ac71b1c8b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.806409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.807218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.807502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.807779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.808467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.809837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:09.822152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:09.823127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:09.824572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 476/960] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:09.825373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.868870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239cc8-9b21-40a2-a2cf-a85cec5850f3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.902291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.902942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.903219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.903492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.904257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.905628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.909756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.937973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538e1ce-e402-433c-8c84-5c5eb16f96c4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:09.947586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:09.973217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:09.973878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:09.974158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:09.974433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:09.975363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:09.975650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:09.977045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:09.986003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 477/961] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:09.986792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:09.994446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 485/962] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:09.995920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.158825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a3775-3c95-41b3-a3e1-bf477b414081 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.162426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebca1-03c3-4eda-a825-7508c40fe905 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.200017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.200684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.201228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.201496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.207714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:10.207714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.207714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082c9bd-a164-4abd-8469-cfad368c9254 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.207950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.207950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.207950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.207950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.208922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 478/963] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:10.213635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a0e4-0fb4-48ba-a2b8-e952c578b268 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.213635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a0e4-0fb4-48ba-a2b8-e952c578b268 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.213635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a0e4-0fb4-48ba-a2b8-e952c578b268 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.213635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 479/964] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:10.216810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a0e4-0fb4-48ba-a2b8-e952c578b268 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.219644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.221523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-85708d1c-da35-4c69-8697-278dba7ffc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:10.240900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:10.242001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:10.243016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:10.243016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:10.243016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:10.243016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:10.243016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 486/965] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:10.243770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.244078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.244356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.259702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.262559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:10.263751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:10.300083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.336047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 487/966] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:10.337167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.349744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a0e4-0fb4-48ba-a2b8-e952c578b268 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.392715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761936-f261-4410-ac75-391af5582690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.393384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761936-f261-4410-ac75-391af5582690 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.393667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761936-f261-4410-ac75-391af5582690 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.393940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761936-f261-4410-ac75-391af5582690 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.394649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761936-f261-4410-ac75-391af5582690 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:10.394949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761936-f261-4410-ac75-391af5582690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.396423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761936-f261-4410-ac75-391af5582690 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.401313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 480/967] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:10.402116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761936-f261-4410-ac75-391af5582690 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.473974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861c70-e10d-43a6-97e1-32bcfcb9ccf1 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.514060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.518512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761936-f261-4410-ac75-391af5582690 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.526087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.527259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.527729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.528203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.529120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:10.533660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.533660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.553780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 488/968] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:10.558835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.570584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.572097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.572838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.573539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.574756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.576904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.578526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING keystone.server.flask.common [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 14:35:10.605010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.626287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.sql.core [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 14:35:10.626287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 14:35:10.626287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [parameters: {'user_id': '30e26e690e1b4f2caf9a6d09117cb97d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 14:35:10.626287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87016) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result.read() Jun 15 14:35:10.634409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:35:10.637640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application yield resource Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application next(self.gen) Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise self.value Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application session.commit() Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 14:35:10.638596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.session.flush() Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application compat.raise_( Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 14:35:10.639521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 14:35:10.640456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application conn.query(q) Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application result.read() Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 14:35:10.641323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [parameters: {'user_id': '30e26e690e1b4f2caf9a6d09117cb97d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:10.642161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 14:35:10.642964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 481/969] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jun 15 14:35:10 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:10.644101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.702159 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12cff-84c1-4ba6-b7fc-0e682921b91f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.743504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.744881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.745304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.745741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.754729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.757098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.773379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb359-a523-466f-a645-89295ce2e909 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:10.774849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:10.775767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 14:35:10.776749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:10.779617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 489/970] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:10.785439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.812959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.813920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.814702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.815056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.827230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.830012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:10.849914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:10.851841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 14:35:10.853044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:10.854425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 482/971] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:10.859974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.889306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.908234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:10.918272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f840-525f-4e15-b065-d6f76f48f62d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:10.961170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:10.961863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:10.962146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:10.962423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:10.963271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:10.963579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:10.965295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:10.984485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 490/972] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:10.990366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:10.996381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034967-dfe6-479e-afa9-92eecb85df76 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:11.033810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:11.034922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:11.035414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:11.035932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:11.036966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:11.037466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:11.039305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:11.088144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 483/973] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:11.103385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303f7b-ec52-47d8-a0b2-4567c97cefe1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:11.147261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:11.147970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:11.148251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:11.148526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:11.170620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:11.231313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:11.232842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:11.347050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 491/974] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:11.353869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:11.455407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:11.483983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f804-e68a-4038-a20c-59cc528b3789 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:11.519923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:11.520689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:11.520974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:11.521257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:11.535165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:11.537641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:11.557066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:11.558077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:11.558988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:11.558988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:11.558988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:11.558988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:11.558988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 484/975] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:11.564980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:11.621694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:11.691515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a21e-fba1-40fa-988f-2aff81299308 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:11.739679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:11.740405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:11.740687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:11.741598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:11.742478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:11.742784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:11.744194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:11.757965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 492/976] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:11.763614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:11.878089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0762-4553-480d-8322-f12b64bc6bd1 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:11.909147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:11.915764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:11.916772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:11.917216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:11.917675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:11.925604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:11.927092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:11.943764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:11.945361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:11.946283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 485/977] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:11.953549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.067220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042583ad-ab77-4c56-ac52-5865bb1d772f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:12.077819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:12.102642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:12.103299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.103578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.104139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.104646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:12.104947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:12.106453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c353c2-3e31-49de-ba50-2d80a10f91e2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:12.124415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 493/978] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:12.125912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.219785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135752-fd1b-4ea6-bcce-8f3feb0599e9 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.219997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135752-fd1b-4ea6-bcce-8f3feb0599e9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.220279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135752-fd1b-4ea6-bcce-8f3feb0599e9 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.221836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 494/979] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:12.227395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.227672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.227985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.246218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:12.246443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490e63-75c5-40e4-9d33-21ba9a175ade None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:12.247411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:12.287517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:12.288383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.288667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.288971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.289846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] RBAC: Adding query filter params (role.id=5e981a2bb98943a68625fe1ad6bb9585, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=5ce3d2e9dc934c84b40ceec3903fccb2) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:12.290296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:12.292857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:12.310953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 486/980] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:12 2022] GET /identity/v3/role_assignments?user.id=5ce3d2e9dc934c84b40ceec3903fccb2&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=5e981a2bb98943a68625fe1ad6bb9585 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:12.329600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 495/981] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:12.353991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.441297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:12.505201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2cdc-8bf7-4d5f-81b3-c54d9d6b0416 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:12.555239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:12.556093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.556376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.556643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.557302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:12.558677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-707884cc-b5f8-496d-8eae-7364bd4000c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:12.576629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:12.577871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:12.578735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:12.583537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 487/982] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:12.585681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.713136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:12.717313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3501ca-dad7-4b70-abe1-60a3591ef8cc None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.717313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3501ca-dad7-4b70-abe1-60a3591ef8cc None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.717585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3501ca-dad7-4b70-abe1-60a3591ef8cc None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.718224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071bdd9-ae5c-4a8c-8198-75946ec66788 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:12.723901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 488/983] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:12.729911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.729911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.730147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.755520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:12.757180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:12.761259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:12.761932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.762208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.762477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.763183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:12.763484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:12.764893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:12.775292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 496/984] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:12.777222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.850061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 489/985] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:12.874189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.896814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ae5a-46d7-48d8-9ab2-01561fbc62c9 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:12.937952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:12.938725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:12.939081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:12.939355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:12.940164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:12.940470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:12.941876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:12.942314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:12.947580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 497/986] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:12.953735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:12.982959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:13.013385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82569ba3-5940-499e-9d8c-75fe53298b2e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:13.060880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:13.061564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:13.061852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:13.062129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:13.062861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:13.064277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057644-e367-4240-ae95-6a2c91484461 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:13.066344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4903ed2-fe3e-4246-b86e-dbcdc4553c81 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:13.102549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:13.103211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:13.103491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:13.103765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:13.104603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] RBAC: Adding query filter params (interface=admin, service_id=3329616f88da44578caf56f261295e85, region_id=RegionOne) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:13.104911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:13.106309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:13.111679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 498/987] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Jun 15 14:35:12 2022] GET /identity/v3/endpoints?service_id=3329616f88da44578caf56f261295e85&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:13.117850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:13.138490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 490/988] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:35:12 2022] POST /identity/v3/services => generated 242 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:35:13.227484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:13.237500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2be2-f5d4-4b99-9032-5099e7e0127a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:13.283250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:13.284337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:13.284840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:13.285308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:13.286198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:13.288085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d76e-8278-4c6e-81f6-535b38149658 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:13.296061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 499/989] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:13 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:35:14.578300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff57f8-e095-4acc-9008-e93a8f72c918 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:14.578880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff57f8-e095-4acc-9008-e93a8f72c918 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:14.578880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff57f8-e095-4acc-9008-e93a8f72c918 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:14.580349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 491/990] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:14.585844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:14.586321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:14.586415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:14.603823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:14.605031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:14.679610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 500/991] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:14.699857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff57f8-e095-4acc-9008-e93a8f72c918 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:14.817418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff57f8-e095-4acc-9008-e93a8f72c918 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:14.827968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:14.854489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:14.855286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:14.855568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:14.855869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] PATH_INFO: `/v3/services/image` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:14.856553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:14.857928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:14.870315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:14.871397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:14.877238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 492/992] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jun 15 14:35:14 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:14.879890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:14.968360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:14.988842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21c93b-c236-48f6-8367-b1421a71a063 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.025712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.026391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.026678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.026955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.027671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] RBAC: Adding query filter params (name=image) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:15.028002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.029384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5965b-588d-47a8-9dc0-6953560c03ec None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.035986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 501/993] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:15.040284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.149394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5196-92ae-4fe9-9f71-b479c5fc4c1a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.184355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.185021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.185300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.185573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.186288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] RBAC: Adding query filter params (type=image) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:15.186589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.187981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bca498-c504-4e70-968a-557612a31e81 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.199839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 493/994] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:15.385208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1cf8f-02a9-4c70-b67a-0ce234851368 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.385495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1cf8f-02a9-4c70-b67a-0ce234851368 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.385776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1cf8f-02a9-4c70-b67a-0ce234851368 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.387147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 502/995] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:15.392793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622170b3-0ced-4997-aeab-afa484a2cc6c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.393089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622170b3-0ced-4997-aeab-afa484a2cc6c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.393375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622170b3-0ced-4997-aeab-afa484a2cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.411210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-622170b3-0ced-4997-aeab-afa484a2cc6c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:15.412356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-622170b3-0ced-4997-aeab-afa484a2cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:15.446478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:15.489754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 494/996] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:15.505027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ebeb-a1ad-4d8b-89f3-53d569677d24 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.505310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ebeb-a1ad-4d8b-89f3-53d569677d24 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.505590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ebeb-a1ad-4d8b-89f3-53d569677d24 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.507672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 503/997] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:15.512427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5ebeb-a1ad-4d8b-89f3-53d569677d24 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.512901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.513128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.513411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.530817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:15.532055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:15.608666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 495/998] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:15.625566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5ebeb-a1ad-4d8b-89f3-53d569677d24 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.631869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.667370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.668124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.668401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.669366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.669366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.670673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:15.682892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:15.684181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:15.685046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 504/999] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:15.690274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.703420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:15.747656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:15.753828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d87cad-6702-4b5e-8a4b-1c70e7f38d24 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.793416 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.794244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.794536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.794804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.795469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.796877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.807770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135058dd-3d06-4480-a4a1-81161273258a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:15.809351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:15.810312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:15.811163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 496/1000] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:15.816424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.851178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.852284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.852570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.852849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.853570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:15.853879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.855270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.861137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 505/1001] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:15.867612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:15.938481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0502-d506-44c1-81ba-62bc8185fec9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.946785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:15.977724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:15.978613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:15.979040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:15.979395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:15.980240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:15.980617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:15.982109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:15.986530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9940-dda9-47d9-a747-3f86c1959f56 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:15.987712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 497/1002] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:15.994198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:16.020813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:16.027167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:16.028475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:16.028475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:16.028475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:16.029168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:16.029473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:16.030845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:16.036213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 506/1003] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:16.042531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:16.104483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696c158-e4ff-4ecf-a807-9f307c80466b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:16.143042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:16.143718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:16.144037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:16.144321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:16.145040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:16.145435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:16.146744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:16.156837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 498/1004] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jun 15 14:35:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:16.157040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152fd8-9a9a-4224-a093-cadbfb9c4de3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:16.159381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:16.194541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:16.195516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:16.196062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:16.196447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:16.197256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] RBAC: Adding query filter params (interface=public, service_id=07c5fd9071c2418b9f7b3f3e0af08eac, region_id=RegionOne) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:16.197569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:16.198982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:16.201949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:16.205545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 507/1005] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:35:16 2022] GET /identity/v3/endpoints?service_id=07c5fd9071c2418b9f7b3f3e0af08eac&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:16.212008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:16.263252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:16.276641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf4d9-c551-46b0-a077-5d1fbb27b582 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:16.312243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:16.312965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:16.313245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:16.313519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:16.314289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:16.315954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab2db8-33d2-4208-b76c-7e67684718bf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:16.329366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f326c-3cfd-4790-9612-40132665c44d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:16.365366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:16.366064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:16.366350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:16.366816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:16.367515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:16.368949 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d510-8952-49e7-b353-dfc6e1442017 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:16.375571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 508/1006] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:16 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:35:16.399838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 499/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:17.377238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e94bd-7a6d-42f9-9d59-6cf7ba4b4a9d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:17.377764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e94bd-7a6d-42f9-9d59-6cf7ba4b4a9d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:17.377764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e94bd-7a6d-42f9-9d59-6cf7ba4b4a9d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:17.379320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 509/1008] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:17.385131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4efa-31a3-4e0f-9e6e-8a12b8ea65f7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:17.385564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4efa-31a3-4e0f-9e6e-8a12b8ea65f7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:17.385767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4efa-31a3-4e0f-9e6e-8a12b8ea65f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:17.402664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-01ee4efa-31a3-4e0f-9e6e-8a12b8ea65f7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:17.403870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-01ee4efa-31a3-4e0f-9e6e-8a12b8ea65f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:17.481265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 500/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:17.504918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e94bd-7a6d-42f9-9d59-6cf7ba4b4a9d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:17.575056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:17.618146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e94bd-7a6d-42f9-9d59-6cf7ba4b4a9d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:17.654647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:17.655227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:17.655509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:17.655787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:17.656540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:17.657916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0e73-a10b-457c-97f6-10ec9bde2400 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:17.758010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 510/1010] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:35:17 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:18.576814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56bf5-e08a-4a9e-a325-05feafadf6a8 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.577337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56bf5-e08a-4a9e-a325-05feafadf6a8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.577337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56bf5-e08a-4a9e-a325-05feafadf6a8 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.578942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 501/1011] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:18.584198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.585287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a609-4964-4445-91b1-5c00f563fc99 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.585384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.585503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a609-4964-4445-91b1-5c00f563fc99 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.585598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.585671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a609-4964-4445-91b1-5c00f563fc99 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.587248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 502/1012] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:18.592810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.593097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.593374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.603502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:18.604741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:18.610878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:18.612094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:18.694806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 511/1013] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:18 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:18.695013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 503/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:18 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:18.708040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:18.709260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:18.713730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:18.770170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:18.821755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e29fb-3e48-47bf-a00c-55caf7e67adc None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:18.828084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f800-3f54-4c6c-b26d-bc4865804bf3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:18.858570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:18.859463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.859757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.860058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.861249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:18.862785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:18.864443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 504/1015] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:18.870705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:18.872470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:18.873296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:18.873705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:18.873987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:18.874780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:18.876212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:18.889385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:18.890505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:18.891597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 512/1016] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:18.897620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:18.956617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:18.988898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4556c-9332-44cb-b748-90b8f8997cd3 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:19.017742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da737b6-083c-4f83-9ffd-d4680cf3ed94 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:19.027046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:19.027725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.028037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.028309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:19.029024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:19.030467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:19.035365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:19.056536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:19.057202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.057481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.057752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:19.058455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:19.058760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:19.060203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:19.065097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 513/1017] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:19.071273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:19.128141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 505/1018] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:35:18 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:35:19.213533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff408972-2bbe-44af-a4ef-62a346fc95e6 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:19.250864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:19.251543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.251847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.252120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:19.252842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:19.253143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:19.254560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecd86e-71f9-496b-80b0-f4df3dad0722 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:19.261304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 514/1019] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jun 15 14:35:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:19.267046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:19.376667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519cb3-f625-467e-9557-6000c61b76fc None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:19.403392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:19.414775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:19.415443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.415728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.416030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:19.416793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:19.418165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99de62-670e-4fb3-b7fb-56576d865ecc None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:19.503050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 506/1020] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:19.987399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c997b9-b6c4-4c19-8933-06879abc6c9c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.987917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c997b9-b6c4-4c19-8933-06879abc6c9c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.988037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c997b9-b6c4-4c19-8933-06879abc6c9c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:19.989678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 515/1021] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:19.995866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db56b-2435-4266-addc-4598fa752527 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:19.996305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db56b-2435-4266-addc-4598fa752527 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:19.996479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db56b-2435-4266-addc-4598fa752527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.016348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-299db56b-2435-4266-addc-4598fa752527 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:20.017678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-299db56b-2435-4266-addc-4598fa752527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:20.098105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 507/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:20.123456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c997b9-b6c4-4c19-8933-06879abc6c9c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:20.170364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:20.232883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c997b9-b6c4-4c19-8933-06879abc6c9c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:20.273450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:20.274177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:20.274488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:20.274768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] PATH_INFO: `/v3/services/image` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.275438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:20.277253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:20.289725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:20.290853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:20.291725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:20.296290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 516/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jun 15 14:35:20 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:20.297419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db56b-2435-4266-addc-4598fa752527 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:20.408085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db56b-2435-4266-addc-4598fa752527 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:20.416391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:20.448480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:20.449162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:20.449445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:20.449721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.450439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] RBAC: Adding query filter params (name=image) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:20.450743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:20.452413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:20.462757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 508/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:20.464366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:20.574051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f8b4-56d8-4116-abd8-4831864100cf None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:20.581518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:20.609863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:20.610529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:20.610810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:20.611085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.611792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] RBAC: Adding query filter params (type=image) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:20.612122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:20.613491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:20.623721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 517/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:20.625306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:20.740140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f586-deaa-497e-9813-4fd0cfb9f762 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:20.777710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:20.778389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:20.778663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:20.778934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.779727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] RBAC: Adding query filter params (interface=public, service_id=9dee9c3687354c1fb4a229e12cbcfee0, region_id=RegionOne) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:20.780083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:20.781452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891fd22-5295-475b-b0ac-28ce9c410827 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:20.791934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 509/1026] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:35:20 2022] GET /identity/v3/endpoints?service_id=9dee9c3687354c1fb4a229e12cbcfee0&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:20.793103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:20.899178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32cee-ae1e-4105-b18c-f3144d0ebdb8 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:20.933605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:20.934269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:20.934546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:20.934815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:20.935500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:20.936903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6fb83-690a-42f6-bec5-c05638306b34 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:20.952078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 518/1027] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:35:20 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:35:21.414016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdca74-51c0-4ea6-99d3-880d8a92e67d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.414546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdca74-51c0-4ea6-99d3-880d8a92e67d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.414623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdca74-51c0-4ea6-99d3-880d8a92e67d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.416199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 510/1028] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:21.421471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.421896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.422088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.439683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:21.440918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:21.470904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:21.514072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 519/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:21.539847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdca74-51c0-4ea6-99d3-880d8a92e67d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:21.575979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:21.645539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdca74-51c0-4ea6-99d3-880d8a92e67d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:21.686834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:21.687569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.687880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.688163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.689380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:21.690829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be218-eb63-45c3-b68a-37bc963c5550 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:21.697816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 511/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:21.699395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:21.794116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01504bf-f043-407e-8ac3-f88435345d0c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.794404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01504bf-f043-407e-8ac3-f88435345d0c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.794686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01504bf-f043-407e-8ac3-f88435345d0c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.796379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 512/1031] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:21.801044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.801410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.801759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.818562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:21.818950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9b6f-0d91-4b95-a1fc-d9ddae8ff8f6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:21.820301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:21.860150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:21.860826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:21.861112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:21.861385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:21.862102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:21.863552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:21.895215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 513/1032] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:21.919658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:21.950529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:21.973295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 520/1033] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:35:21 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:22.031151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74edef-474f-4f24-8184-93189cdea338 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.077035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.077905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.078186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.078460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.091391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:22.099974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:22.101033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:22.102223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 514/1034] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:35:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:22.107687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:22.138274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:22.229316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23412d0-d023-4425-b425-80c0aa9e6564 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.266576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.267255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.267538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.267836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.268604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:22.268910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:22.270293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:22.280583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 521/1035] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:35:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:22.286569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:22.400253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:22.409228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557b47-2fd6-4527-b9bf-de048b515a73 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.447458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.448292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.448574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.448846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.461333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:22.462784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:22.480813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:22.481742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:22.482801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:22.482801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:22.482801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:22.482801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:22.482801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 515/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:22.487676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:22.575826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:22.595373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218312d3-7e8b-4510-b934-e672f8014b53 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.631599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.632681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.632968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.633239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.633973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:22.634277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:22.635650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:22.652741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 522/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:22.654399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:22.764611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e30f2-fb6f-410d-9da4-55a0f27a710b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.804464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.805456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.805738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.806011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.814592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:22.817293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:22.833442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:22.834452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:22.840632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 516/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:35:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:22.842761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:22.953615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36409db7-7584-424a-bece-13d61df5c711 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:22.989110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:22.989705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:22.989986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:22.990262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:22.991181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:22.991742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:22.993346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764d43-ab79-4e65-ab78-58a0e05244f9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.009157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.018025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 523/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:35:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:23.019942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.025442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.130619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c6d8-a2c8-44c9-87a4-0c93bbf3971f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.141906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a02b90-e946-4eca-b7ef-fc4bc6c9fcf6 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.142197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a02b90-e946-4eca-b7ef-fc4bc6c9fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.142479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a02b90-e946-4eca-b7ef-fc4bc6c9fcf6 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.143914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 524/1040] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:23.149579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.149872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.150153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.169680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:23.170866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:23.171668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.172395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.172679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.172963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.247118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.251996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 525/1041] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:23.252167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.253720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.271140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.359893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 517/1042] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:23.365336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.384769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf50cf-01ea-445b-bbf1-f884f8d775f5 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.414481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.420897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.426763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.426763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.426763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] PATH_INFO: `/v3/services/image` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.426763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.426763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:23.436811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:23.437869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:23.438748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 526/1043] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:23.445694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.481725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66604c5c-45aa-43ad-b32f-0d599750a341 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.484763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.518878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.519600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.519973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.520242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.531562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.533031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:23.551301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:23.552348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:23.553273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:23.553273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:23.553273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:23.553273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:23.553273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 518/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:23.558741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.559363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842934fe-7245-41a3-a7a2-2bca8d41c73d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.596108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.596778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.597061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.597336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.598050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] RBAC: Adding query filter params (name=image) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:23.598353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.599733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.606015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 527/1045] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:23.611467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.665489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933749df-2fc3-48bf-952e-9f991832f58f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.674332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.704708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.705376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.705660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.705935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.706974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:23.706974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.708441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.720954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae115d1a-6d6b-4dfe-9e12-bbda85e1ab30 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.721665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 519/1046] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:23.727265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.751846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.762802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.765624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.765624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.765624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.765624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] RBAC: Adding query filter params (type=image) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:23.765624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.766480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.771774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 528/1047] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:23.778126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.842796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058043-7725-4ccc-a86b-a4d7a4cb3ff9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.881232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.882247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.882538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.882823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.886468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886434b-d581-40d9-9f60-c9acd7f097ff None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:23.890122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.891579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:23.906843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:23.907766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:23.909553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 520/1048] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:23.911943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:23.914421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:23.924348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:23.925299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:23.925299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:23.925789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:23.926373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:23.927759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:23.995458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:24.001169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 529/1049] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:35:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:35:24.033187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c24f-8ba2-4932-af5a-620398ccad5e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:24.082402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:24.083290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.083577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.083883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.085266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:24.085579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:24.087077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf3c6-0f02-482b-ae01-5401ad54a376 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:24.100565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 521/1050] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:24.106788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:24.222945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad4c2-f6ed-46c2-984d-85d19aa91766 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:24.256391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4322-4011-401c-8a8d-e510dd7dda5c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.257334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4322-4011-401c-8a8d-e510dd7dda5c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.257719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4322-4011-401c-8a8d-e510dd7dda5c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.259106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 522/1051] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:24.259502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:24.260192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.260527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.260802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.261638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] RBAC: Adding query filter params (role.id=5e981a2bb98943a68625fe1ad6bb9585, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:24.261944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:24.263510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:24.264641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.264937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.265210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.271086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 530/1052] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:24 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=5e981a2bb98943a68625fe1ad6bb9585 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:24.284113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:24.285264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:24.379016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 523/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:24.404129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:24.454909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:24.514019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779701-6202-4eab-b721-770bbd9c2081 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:24.551295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:24.552054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.552337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.552618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.564980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:24.572696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:24.573659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:24.574500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:24.575903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 531/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:24.581230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:24.648050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:24.686633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6ad0b-d2be-48a6-9964-bdf5830eaa70 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:24.720434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:24.721104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.721389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.721673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.722420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:24.722720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:24.724119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:24.734950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 524/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:24.740377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:24.847887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74caa-9562-46c7-bee0-d6432e997d44 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:24.849531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:24.884965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:24.885849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:24.886133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:24.886412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] PATH_INFO: `/v3/users/5b550f966b7044a8949b668a4f1085f4` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:24.900318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] RBAC: Authorizing `identity:get_user(user_id=5b550f966b7044a8949b668a4f1085f4)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:24.901773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:24.908046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 532/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:24 2022] GET /identity/v3/users/5b550f966b7044a8949b668a4f1085f4 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:24.909542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:25.012150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d98e-d11c-4bc4-8962-8602b9015695 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:25.035317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:25.048840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:25.050774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:25.050774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:25.050774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:25.119128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:25.120536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:25.228652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 525/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:25.229824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:25.331394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a511-d434-4051-8f8d-6588a447cf2b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:25.366810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:25.367665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:25.367980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:25.368249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:25.369482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:25.370859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f293c5-6d9a-4c47-9cf7-54ae0ca3406f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:25.372754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 533/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:25 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:25.378668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:25.403551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:25.482467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a003d26-1eef-4bc5-bca8-82bd321a210b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:25.515651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:25.516329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:25.516612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:25.516883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:25.517710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=748ae2cd8e1c4d84a455278c407dc560, user.id=5b550f966b7044a8949b668a4f1085f4) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:25.518016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:25.519445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9452b-4692-4386-9420-fd390b8b8faa None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:25.531841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 526/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:25 2022] GET /identity/v3/role_assignments?user.id=5b550f966b7044a8949b668a4f1085f4&scope.project.id=748ae2cd8e1c4d84a455278c407dc560&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:26.269840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860aaf-499e-42f8-8d01-27c0f239dbdf None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.270361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860aaf-499e-42f8-8d01-27c0f239dbdf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.270440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860aaf-499e-42f8-8d01-27c0f239dbdf None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.271975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 534/1060] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:26.277876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370151e-afeb-4f94-9710-ac1d95de7ea8 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.278309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370151e-afeb-4f94-9710-ac1d95de7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.278488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370151e-afeb-4f94-9710-ac1d95de7ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.295578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d370151e-afeb-4f94-9710-ac1d95de7ea8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:26.296825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d370151e-afeb-4f94-9710-ac1d95de7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:26.369507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 527/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:26.392815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860aaf-499e-42f8-8d01-27c0f239dbdf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:26.425419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:26.490330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e314-cdc7-4801-ba96-ae5c5217c297 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.490682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e314-cdc7-4801-ba96-ae5c5217c297 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.491025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e314-cdc7-4801-ba96-ae5c5217c297 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.492602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 528/1062] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:26.497588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.497880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.498166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.505482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860aaf-499e-42f8-8d01-27c0f239dbdf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:26.515867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:26.517075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:26.531256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:26.541307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:26.541956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.542235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.542507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.592787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 529/1063] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:26.616314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:26.622095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:26.623565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:26.654951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:26.736735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d77699-9ffd-4aee-86f1-613f92b0df2f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:26.757373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 535/1064] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:26.759036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:26.796549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:26.797340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.797630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.797903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.808850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:26.817194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:26.818200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:26.819220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:26.823792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 530/1065] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:35:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:26.824721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:26.843445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:26.884434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85772968-56b3-4178-94b1-0ba6edd5fffc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:26.912393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:26.920820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:26.922131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:26.922131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:26.922308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:26.934630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:26.936923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:26.958341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:26.959321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:26.960876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:26.960876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:26.960876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:26.960876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:26.965437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 536/1066] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:26.966362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:26.969079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169d355-085b-4cd0-aa70-d4b3f7334671 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.011001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.011775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.012332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.012686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.014318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:27.016129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.017724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.028621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 531/1067] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:35:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:27.041314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.121702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79434b-aebc-4c53-8033-6d36c304e51f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.127925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:27.174733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.175414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.175699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.176025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.176766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:27.177074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.177246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35a152-083b-4520-880e-c8a55caae2e5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.178517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.191844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 537/1068] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:27.224282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.225112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.226245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.226403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.239548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.241368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:27.262575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:27.263702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:27.265496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:27.265496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:27.265496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:27.265496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:27.268335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 532/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:27.269829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.323506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:27.389680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f911e4-df5a-459f-a53e-edea3917041b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.426193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.426794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.427079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.427383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.428162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:27.428537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.429925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.442259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 538/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:27.448724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.558397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e10e8-0dd7-4e83-8cbf-65b33779f55a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.581634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:27.593938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.601339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.601339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.601339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.604429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.605884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-4ad8d872-7de6-4784-9842-ce822dea0236 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:27.621449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:27.622678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:27.623683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 533/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:27.628919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.686186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d12-a7a2-49c7-8256-eef52fc42735 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.686490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d12-a7a2-49c7-8256-eef52fc42735 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.686777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d12-a7a2-49c7-8256-eef52fc42735 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.688234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 534/1072] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:35:27.694003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.694365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.694651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.712705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:27.713932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:27.744994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:27.749118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69dfc5-f3fa-405e-9d5b-af73a9d6e814 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.786059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.786798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.787079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.787352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.788668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 535/1073] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:27.788885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:27.789075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.790678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.809359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 539/1074] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:27.811423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.814852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.920901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276c918-41cd-4aae-a69a-637df7aedb22 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.923027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0fb30-8f5e-4d27-bc04-eb34d2290143 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:27.936993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:27.957364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.958155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.958435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.958570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:27.958708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.959230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:27.959508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:27.960568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:27.969789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:27.970829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:27.971265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:27.978728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:27.979894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:27.981089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 536/1075] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:27.986224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:27.991393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:27.992446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:27.993542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:27.993542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:27.993542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:27.993542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:27.993542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 540/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:27.998367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.011067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:28.090250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf66d-6b76-4dfa-bded-c5757c53d887 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.104065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093d9f-7b24-4eea-a3c9-4ed3918ae0bd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.124743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.125411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.125693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.125967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.126712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:28.127017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.128490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.137421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 537/1077] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:28.139583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.140435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.140778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.141117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.141934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:28.142245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.143293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.143615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.157021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 541/1078] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:28.162630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.178882 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:28.233650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:28.246669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8653bc-651e-411f-8c15-1b9991153624 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.266133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a1de-9f5f-45aa-a1f7-88b9417d3460 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.281273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.282143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.282421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.282692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] PATH_INFO: `/v3/users/5b550f966b7044a8949b668a4f1085f4` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.283930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] RBAC: Authorizing `identity:get_user(user_id=5b550f966b7044a8949b668a4f1085f4)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.285354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.287000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 538/1079] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:28 2022] GET /identity/v3/users/5b550f966b7044a8949b668a4f1085f4 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:28.292796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.301411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.302225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.302508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.302785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.310624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.312115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:28.327625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:28.330025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:28.331774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:28.334143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 542/1080] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:28.335284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.399545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b76a-037a-404f-af6b-baff39015feb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.401205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:28.436815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.437691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.437969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.438294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.439900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.441111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55511-f586-42db-9d11-c3d6f340d4f1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.441684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.448875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 539/1081] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:28 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:28.449913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.472612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:28.479646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.480353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.480635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.483467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.483467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:28.483467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.483467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.496018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 543/1082] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:28.501953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:28.555992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a486ea9-abc8-4fb4-9198-4689653cfc6b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.591528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.592702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.592974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.593244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560/users/5b550f966b7044a8949b668a4f1085f4/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.595264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] RBAC: Authorizing `identity:create_grant(project_id=748ae2cd8e1c4d84a455278c407dc560, user_id=5b550f966b7044a8949b668a4f1085f4, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.596777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09729dc-130e-4e2d-a7a9-1c04a992939a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.607585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e9e-afd2-437f-9200-6b7b91f474cc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:28.643248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:28.644176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:28.644454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:28.644726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/5e981a2bb98943a68625fe1ad6bb9585` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:28.647018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=8b2601ad8d254730b33d16e6ed1156cf, role_id=5e981a2bb98943a68625fe1ad6bb9585)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:28.648729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa90b9-6a86-427b-9c97-a910b6d9551e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:28.670216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 540/1083] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:35:28 2022] PUT /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560/users/5b550f966b7044a8949b668a4f1085f4/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:35:28.749984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 544/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:35:28 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/8b2601ad8d254730b33d16e6ed1156cf/roles/5e981a2bb98943a68625fe1ad6bb9585 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:35:30.808907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a37-a796-4b08-bd9c-98a7a5e80f2f None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:30.809455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a37-a796-4b08-bd9c-98a7a5e80f2f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:30.809546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a37-a796-4b08-bd9c-98a7a5e80f2f None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:30.810871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 541/1085] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:30.816557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:30.817102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:30.817102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:30.836196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:30.837472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:30.886224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:30.888428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275188d-9935-47c7-a8b6-37281ba7d847 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:30.888713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275188d-9935-47c7-a8b6-37281ba7d847 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:30.888988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275188d-9935-47c7-a8b6-37281ba7d847 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:30.890390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 542/1086] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:30.895274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:30.895556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:30.907666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:30.907844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 545/1087] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:30.914048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:30.915232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:30.931751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:30.940787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:30.996930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 543/1088] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:35:31.023104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.044986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e7038-43f2-494d-8c0a-3062589d3a48 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.079554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.080371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.080648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.080914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.091508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:31.099140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:31.100894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:31.102063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 546/1089] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:31.106813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.124926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38756a02-e146-41f6-ae87-f8cd9ed6d41f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.148105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.158263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.159067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.159341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.159608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.170514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:31.179351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:31.180383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:31.181399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 544/1090] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:31.186504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.208227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d471c-73f6-40dd-9b14-62dd70a46033 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.214802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.243187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.243892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.244171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.244452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.245191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:31.245494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.246865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.255137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 547/1091] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:31.260887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.300636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb47cb-c3ec-4448-a6eb-22c2b62d52f0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.342375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.343168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.343450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.343782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.344559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:31.351688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.351688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.362024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 545/1092] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:31.364002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.382090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f046-e9f5-46f7-94ce-ad50059413ef None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.384855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.418700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.419571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.419870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.420147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] PATH_INFO: `/v3/users/5b550f966b7044a8949b668a4f1085f4` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.421449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] RBAC: Authorizing `identity:get_user(user_id=5b550f966b7044a8949b668a4f1085f4)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.422883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.424772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 548/1093] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/users/5b550f966b7044a8949b668a4f1085f4 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:31.430471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.490138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.515850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c49c-0dc3-445f-8f21-a7840baf06f0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.542185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.542638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de0f48-d518-4509-879f-b26b84e30aba None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.543099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.543391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.543675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.554863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.556380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:31.573860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:31.574848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:31.575787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:31.575787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:31.575787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:31.575787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:31.575787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 546/1094] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:31.576724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.577366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.577645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.577917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.580894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.621200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.649268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.650733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.683832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53777db-97b8-4219-99b1-1d1311102a07 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.721855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.722521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.722813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.723094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.723843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:31.724157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.725586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.733779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.739525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:31.745116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.763863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 549/1096] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:31.769937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.840889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:31.847010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b11d7-05b5-4d43-a213-6ad651eb8a9a None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.871850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0709-95a2-40d5-8654-6a2db2e450a3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:31.880892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.882184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.882463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.882735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.890604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.892072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:35:31.908112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:31.909231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:31.910225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 548/1097] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:35:31.910835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:31.911406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:31.911727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:31.912003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:31.913405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:31.915028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:31.915298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.921717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 550/1098] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:31.922711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:31.974694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.019358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0b6-28e9-4c7b-864f-06b4146fee05 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.026602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cf6d-77c1-49b7-b845-6ac24d7e49e3 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.054143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.054804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.055085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.055404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.056334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:32.056640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.060103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.061632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.062301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.062983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.062983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.063659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=748ae2cd8e1c4d84a455278c407dc560, user.id=5b550f966b7044a8949b668a4f1085f4) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:32.064002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.065429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.072252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 551/1099] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/role_assignments?user.id=5b550f966b7044a8949b668a4f1085f4&scope.project.id=748ae2cd8e1c4d84a455278c407dc560&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:32.077234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 549/1100] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jun 15 14:35:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:32.085602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:32.085602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.199754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56547-d488-4388-95ee-609e4bc3f8eb None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.235466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.236149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.236432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.237101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.306162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.307529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.309391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.414233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 552/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:32.419979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:32.519489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3470a-2c69-418c-b950-0e7ac7b479a7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.532658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.554707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.555505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.555794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.556097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.566409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.568103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:35:32.586125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:32.587120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:32.588054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:35:32.588054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:35:32.588054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:35:32.588054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:32.588054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 550/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:32.593033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:32.695941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f134db4-a6a6-4381-a1aa-70795560644f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.697732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.741431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.742125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.742404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.742679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.743424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:32.743733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.745196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.758592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 553/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:32.764137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:32.874937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab52e-7d16-4a6b-8e9d-875554ec6d26 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:32.910399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:32.911203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:32.911482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:32.911813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:32.918877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:32.920359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:35:32.934414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:32.935419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:32.936381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 551/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:32.941410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:33.040554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ffb57-4370-47a2-836d-cd6bda010d46 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:33.073947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:33.074596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:33.074872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:33.075138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:33.075948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:33.076248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:33.077937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023900ed-db36-4534-9765-da5aa066c36c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:33.089839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 554/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:33.095976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:33.122765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:33.198671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884164a-3d1c-4edc-99e7-186195326899 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:33.235610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:33.236300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:33.236580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:33.236850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:33.237712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] RBAC: Adding query filter params (role.id=5e981a2bb98943a68625fe1ad6bb9585, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=8b2601ad8d254730b33d16e6ed1156cf) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:33.238021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:33.239464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3d88-7104-421b-9423-7447baccbff2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:33.246600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 552/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:33 2022] GET /identity/v3/role_assignments?user.id=8b2601ad8d254730b33d16e6ed1156cf&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=5e981a2bb98943a68625fe1ad6bb9585 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:34.271762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eabd0-8a19-4056-a5e1-7bbde57e26f1 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:34.273027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eabd0-8a19-4056-a5e1-7bbde57e26f1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:34.273027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eabd0-8a19-4056-a5e1-7bbde57e26f1 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:34.274306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 555/1107] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:34.279750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:34.280152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:34.280345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:34.297837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:34.299021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:34.373200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 553/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:34.399217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eabd0-8a19-4056-a5e1-7bbde57e26f1 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:34.423865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:34.499987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eabd0-8a19-4056-a5e1-7bbde57e26f1 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:34.533063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:34.533772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:34.534049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:34.534317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:34.535500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:34.536970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525425-4663-4bbb-a652-f044ebfbfa01 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:34.539312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 556/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:34.545315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:34.564200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:34.643445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aebd38-4701-4f36-8f6f-3f4d6759ec4e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:34.676994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:34.677657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:34.677935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:34.678205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:34.678999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:34.680471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ad71-5b8f-4714-9bd0-1bdc0d2ccf39 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:34.761461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 554/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:35:34 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:36.934853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb393-a797-49a5-be89-86bc1dcc17c8 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:36.935379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb393-a797-49a5-be89-86bc1dcc17c8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:36.935379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb393-a797-49a5-be89-86bc1dcc17c8 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:36.936789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 557/1111] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:36.942450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:36.942832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:36.943012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:36.961545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:36.962739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:37.029753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:37.053271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cb393-a797-49a5-be89-86bc1dcc17c8 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:37.151110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:37.161418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cb393-a797-49a5-be89-86bc1dcc17c8 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:37.195593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:37.196471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:37.196748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:37.197019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] PATH_INFO: `/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:37.198486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] RBAC: Authorizing `identity:get_role(role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:37.199993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:37.201623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 558/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:37 2022] GET /identity/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:37.207478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:37.211225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:37.367142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e9f07-f3d8-4586-80d8-c1a16a480b56 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:37.401906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:37.402770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:37.403048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:37.403319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] PATH_INFO: `/v3/users/3da95ad662ab43fba1e9385938a80441` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:37.416663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] RBAC: Authorizing `identity:get_user(user_id=3da95ad662ab43fba1e9385938a80441)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:37.418107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:37.419793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 556/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:37 2022] GET /identity/v3/users/3da95ad662ab43fba1e9385938a80441 => generated 286 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:37.425508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:37.525025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78431803-a060-4458-a3bc-5e08f2bb73fc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:37.558718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:37.559355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:37.559634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:37.559927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:37.586795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:37.628351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:37.629712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:37.729764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:37.735495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:37.797464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:37.836913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b658-2081-4a3e-a496-2c6eebe3623d None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:37.872663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:37.873517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:37.873798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:37.874071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:37.875251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:37.876708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9610200-fba8-4106-b6e7-9b4fabb03738 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:37.878464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 557/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:37 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:37.884752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:37.940928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:37.981842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eb6a4-dde8-422f-a8e4-0d7f454a393a None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:38.016028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:38.016685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:38.016971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:38.017252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:38.018083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=748ae2cd8e1c4d84a455278c407dc560, user.id=3da95ad662ab43fba1e9385938a80441) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:38.018396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:38.019866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccfb87-8399-403e-8f68-497e13d194a8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:38.026230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 560/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:37 2022] GET /identity/v3/role_assignments?user.id=3da95ad662ab43fba1e9385938a80441&scope.project.id=748ae2cd8e1c4d84a455278c407dc560&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:40.144241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454fe1-42c7-4840-8a6b-1e7ea20fcb9c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.144802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454fe1-42c7-4840-8a6b-1e7ea20fcb9c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.144802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454fe1-42c7-4840-8a6b-1e7ea20fcb9c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.146181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 558/1118] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:40.152142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.152555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.152704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.169680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:40.170881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:40.238514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:40.262734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd454fe1-42c7-4840-8a6b-1e7ea20fcb9c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:40.364677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd454fe1-42c7-4840-8a6b-1e7ea20fcb9c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:40.394056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:40.400324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:40.401123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.401404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.401676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] PATH_INFO: `/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.403144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] RBAC: Authorizing `identity:get_role(role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:40.404551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:40.407971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 559/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:40 2022] GET /identity/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:40.412091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:40.470222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:40.518426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af57718-8027-4e38-b8f5-3f42fd4942ff None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:40.552030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:40.552908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.553191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.553466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] PATH_INFO: `/v3/users/3da95ad662ab43fba1e9385938a80441` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.555243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] RBAC: Authorizing `identity:get_user(user_id=3da95ad662ab43fba1e9385938a80441)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:40.556709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:40.558350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 562/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:40 2022] GET /identity/v3/users/3da95ad662ab43fba1e9385938a80441 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:40.564086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:40.667151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672279-133c-4ae8-8e7a-15e1312d1053 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:40.700587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:40.701440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.701973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.702242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.703405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:40.704856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c309a3-020d-4536-b64e-11f81da649d6 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:40.706547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 560/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:40 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:40.713356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:40.811151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5ee9-a3dd-435b-a7ec-33a63d13652e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:40.831715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:40.846280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:40.847156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:40.847434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:40.847707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560/users/3da95ad662ab43fba1e9385938a80441/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:40.849974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] RBAC: Authorizing `identity:create_grant(project_id=748ae2cd8e1c4d84a455278c407dc560, user_id=3da95ad662ab43fba1e9385938a80441, role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:40.851437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43a6c6-1b1d-44a2-994e-30f7aaa4f868 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:40.915586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 563/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:35:40 2022] PUT /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560/users/3da95ad662ab43fba1e9385938a80441/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:35:43.068332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961756e-0381-44bd-8354-c19a9070f66d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.068829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961756e-0381-44bd-8354-c19a9070f66d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.068829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961756e-0381-44bd-8354-c19a9070f66d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.070248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 561/1124] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:43.075563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.076039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.076156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.092677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:43.093839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:43.159316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 564/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:43.184523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961756e-0381-44bd-8354-c19a9070f66d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:43.249973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:43.283940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961756e-0381-44bd-8354-c19a9070f66d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:43.317353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:43.318197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.318527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.318752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] PATH_INFO: `/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.320355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] RBAC: Authorizing `identity:get_role(role_id=334bd4ff61e04fc6b3a4959f2108b27a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:43.321720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:43.323077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 562/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:43 2022] GET /identity/v3/roles/334bd4ff61e04fc6b3a4959f2108b27a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:43.329143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:43.426940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b50df5-c601-441b-9928-44c8500642e9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:43.437483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:43.461295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:43.462157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.462435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.462707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] PATH_INFO: `/v3/users/3da95ad662ab43fba1e9385938a80441` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.463921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] RBAC: Authorizing `identity:get_user(user_id=3da95ad662ab43fba1e9385938a80441)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:43.465351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:43.467269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 565/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:43 2022] GET /identity/v3/users/3da95ad662ab43fba1e9385938a80441 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:43.472733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:43.570212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37616db-c508-45be-8d9e-30997afc4fe5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:43.604738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:43.605376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.605686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.605963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.608619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:43.674048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:43.675490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:43.773953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 563/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:43.780188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:43.879861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56f8-e5e8-40ac-998f-b75c2b8a7918 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:43.913393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:43.914232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:43.914509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:43.914776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] PATH_INFO: `/v3/projects/748ae2cd8e1c4d84a455278c407dc560` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:43.915959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] RBAC: Authorizing `identity:get_project(project_id=748ae2cd8e1c4d84a455278c407dc560)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:43.917384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab23aa-dd79-4c59-9fa3-a6f7a2e79755 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:43.919064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 566/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:43 2022] GET /identity/v3/projects/748ae2cd8e1c4d84a455278c407dc560 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:43.925374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:43.964403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:44.030225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7b6e-e8f8-4b6d-af0b-965241897def None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:44.064097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:44.064742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:44.065023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:44.065296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:44.066117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] RBAC: Adding query filter params (role.id=334bd4ff61e04fc6b3a4959f2108b27a, scope.project.id=748ae2cd8e1c4d84a455278c407dc560, user.id=3da95ad662ab43fba1e9385938a80441) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:44.066429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:44.067870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f1e4-dfae-44f5-9a1c-4a1c5be43ea7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:44.074187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 564/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:43 2022] GET /identity/v3/role_assignments?user.id=3da95ad662ab43fba1e9385938a80441&scope.project.id=748ae2cd8e1c4d84a455278c407dc560&role.id=334bd4ff61e04fc6b3a4959f2108b27a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:46.229132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cbc8-78a1-4b30-9704-c3f7d5323f13 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:46.229665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cbc8-78a1-4b30-9704-c3f7d5323f13 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:46.229665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cbc8-78a1-4b30-9704-c3f7d5323f13 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:46.231036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 567/1131] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:46.236220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:46.236641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:46.236773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:46.254022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:46.255216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:46.322073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 565/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:46.346182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0cbc8-78a1-4b30-9704-c3f7d5323f13 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:46.394877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:46.449604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0cbc8-78a1-4b30-9704-c3f7d5323f13 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:46.483997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:46.484719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:46.485001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:46.485276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:46.486465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:46.487940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e656-8b4c-41ca-9179-f7034a9bf235 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:46.489583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 568/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:46.495419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:46.522291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:46.604754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53aa8-e809-48e3-9cdd-6fb80c9bc284 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:46.638549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:46.639208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:46.639489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:46.639759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:46.640506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:46.641933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf07bd0-cd0a-43c5-a26d-4cdaa962a071 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:46.755695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 566/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:35:46 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:35:48.945470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e050a5-a645-4357-a232-5885b82d6e46 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:48.945982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e050a5-a645-4357-a232-5885b82d6e46 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:48.946070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e050a5-a645-4357-a232-5885b82d6e46 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:48.947390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 569/1135] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:48.952905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:48.953312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:48.953463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:48.970192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:48.971382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:49.038917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 567/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:49.064447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e050a5-a645-4357-a232-5885b82d6e46 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:49.164979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e050a5-a645-4357-a232-5885b82d6e46 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:49.178539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:49.198842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:49.200155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:49.200796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:49.201212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:49.203090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:49.204579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19014e28-52e3-4e8b-8ab6-5c4d9c3d5f87 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:49.206231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 570/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:49.214327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:49.229994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:49.315679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9067512-e758-4bbc-9118-6b33476c426f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:49.349120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:49.349783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:49.350063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:49.350335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:49.351625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:49.353074 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07dce-e225-4f27-8e02-007284a103a1 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:49.418564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 568/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:35:49 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:35:51.620886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2373bc8-4983-4120-8a56-041b4d694a73 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:51.621448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2373bc8-4983-4120-8a56-041b4d694a73 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:51.621448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2373bc8-4983-4120-8a56-041b4d694a73 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:51.622812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 571/1139] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:51.628080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:51.628499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:51.628641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:51.645174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:51.646363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:51.706632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:51.714989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:51.738735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2373bc8-4983-4120-8a56-041b4d694a73 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:51.840298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2373bc8-4983-4120-8a56-041b4d694a73 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:51.880900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:51.881632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:51.881940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:51.882211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:51.891927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:51.899826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:51.900942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:51.901853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 572/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:51.907025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:52.003342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8e6d-b105-48ea-bd9c-99b9ef773218 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:52.036865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:52.037521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:52.037800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:52.038072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:52.038891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:52.039187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:52.040580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:52.049285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 570/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:52.055366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:52.099666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:52.155725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c4c7-de49-43dd-ae57-f867d31bd554 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:52.188455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:52.189317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:52.189595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:52.189866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] PATH_INFO: `/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:52.203878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] RBAC: Authorizing `identity:get_user(user_id=7f290bea01f947c1b0f4af9ed8ad92b1)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:52.205339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:52.206989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 573/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:52 2022] GET /identity/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:35:52.213914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:52.276046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:52.318073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7bfee-21b6-4c0f-95d3-14eb8cf6c88b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:52.350872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:52.351504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:52.351782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:52.352083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:52.416432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:52.417796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:52.475302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:52.517315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 571/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:52.523458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:52.626163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:52.629116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c43dd-6003-4afb-b40d-c5c962bb4969 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:52.662639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:52.664358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:52.665018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:52.665298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] PATH_INFO: `/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:52.666541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] RBAC: Authorizing `identity:get_project(project_id=ef49ccaba3e84bc8b1d95d80075e3c65)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:52.667947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b38873-e5e3-4308-a981-639390d2150a None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:52.669634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 574/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:52 2022] GET /identity/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:52.675773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:52.773783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce177e9-be93-4cde-8e6e-cb2182dae73e None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:52.806793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:52.807424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:52.807702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:52.808006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:52.808825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=ef49ccaba3e84bc8b1d95d80075e3c65, user.id=7f290bea01f947c1b0f4af9ed8ad92b1) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:52.809132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:52.810571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04351b2-796d-41b9-a786-1a9b7c29559b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:52.815821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 572/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:52 2022] GET /identity/v3/role_assignments?user.id=7f290bea01f947c1b0f4af9ed8ad92b1&scope.project.id=ef49ccaba3e84bc8b1d95d80075e3c65&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:54.919083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096da8-0528-4873-9159-5c264ce69286 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:54.919599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096da8-0528-4873-9159-5c264ce69286 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:54.919691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096da8-0528-4873-9159-5c264ce69286 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:54.921029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 575/1147] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:54.926769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:54.927170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:54.927317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:54.944450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:54.945625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:54.961914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:55.012352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 573/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:55.035253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13096da8-0528-4873-9159-5c264ce69286 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:55.141091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13096da8-0528-4873-9159-5c264ce69286 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:55.174462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:55.175248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:55.175530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:55.175829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:55.187915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:55.195710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:55.196836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:35:55.197853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 576/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:55.203394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:55.302089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7688b-a5b5-4a9f-b815-f9a3b820f149 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:55.338301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:55.338960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:55.339241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:55.339511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:55.340300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:55.340601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:55.341954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:55.350054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 574/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:55.356245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:55.385250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:55.455001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f408da-e5a3-4754-bd83-1fde93efec22 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:55.487893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:55.488852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:55.489139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:55.489419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] PATH_INFO: `/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:55.490609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] RBAC: Authorizing `identity:get_user(user_id=7f290bea01f947c1b0f4af9ed8ad92b1)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:55.492645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:55.494295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 577/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:55 2022] GET /identity/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:55.500059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:55.516806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:55.600370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02dee5-153d-43e0-bc27-01ae9c1265fd None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:55.633656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:55.634501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:55.634783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:55.635059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] PATH_INFO: `/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:55.636280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=ef49ccaba3e84bc8b1d95d80075e3c65)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:55.637703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e541-4b2e-4b15-8e45-2f46bb52f2b0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:55.639393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 575/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:55 2022] GET /identity/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:55.645351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:55.739411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:55.745224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089ea5a-1629-4f16-b96a-037cf00b2f6b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:55.779457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:55.780376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:55.780663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:55.780938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] PATH_INFO: `/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65/users/7f290bea01f947c1b0f4af9ed8ad92b1/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:55.782898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef49ccaba3e84bc8b1d95d80075e3c65, user_id=7f290bea01f947c1b0f4af9ed8ad92b1, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:55.784371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a604f0-ec4e-427f-ba2a-569f103e886d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:55.870339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 578/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:35:55 2022] PUT /identity/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65/users/7f290bea01f947c1b0f4af9ed8ad92b1/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:35:57.974726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed2a3-5a2d-4543-af99-e697a6e670eb None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:57.975274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed2a3-5a2d-4543-af99-e697a6e670eb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:57.975274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed2a3-5a2d-4543-af99-e697a6e670eb None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:57.977273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 576/1154] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:35:57.982564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:57.982973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:57.983069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.000907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:35:58.002097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:35:58.067765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 579/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:35:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:35:58.091533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed2a3-5a2d-4543-af99-e697a6e670eb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:58.174566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:58.193580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed2a3-5a2d-4543-af99-e697a6e670eb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:58.227207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:58.228012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:58.228294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:58.228568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.239193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:35:58.247607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:35:58.248825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:35:58.250023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 577/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:35:58.255027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:58.337302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:58.352081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af776-b0f8-43b0-be97-316ed8ff4492 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:58.384746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:58.385403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:58.385682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:58.385957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.386700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:58.387003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:58.388418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:58.396950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 580/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:58.403421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:58.501252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6271d-786c-48bf-b8bb-abc8dfebbf71 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:58.533596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:58.534446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:58.534723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:58.535009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] PATH_INFO: `/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.536196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f290bea01f947c1b0f4af9ed8ad92b1)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:58.537610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:58.539914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 578/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:35:58 2022] GET /identity/v3/users/7f290bea01f947c1b0f4af9ed8ad92b1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:58.545862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:58.644814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781bfe-e766-4b2d-8583-1854f7c96c1d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:58.688818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:58.689460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:58.689741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:58.690012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.708068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:58.757474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:58.759085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:58.855122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 581/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:35:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:58.861038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:58.873169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:58.959559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a87d-8493-4aba-8b25-c1b173b09ea7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:58.993230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:58.994085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:58.994367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:58.994645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] PATH_INFO: `/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:58.995849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] RBAC: Authorizing `identity:get_project(project_id=ef49ccaba3e84bc8b1d95d80075e3c65)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:58.997285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4bae0-6bab-448d-a03d-0bf2cad22c20 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:58.998980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 579/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:35:58 2022] GET /identity/v3/projects/ef49ccaba3e84bc8b1d95d80075e3c65 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:35:59.005041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:35:59.052621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:59.102963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3d60-c0fa-4c07-9b00-89fb6f6c40b2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:35:59.137127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:35:59.137778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:35:59.138055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:35:59.138325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:35:59.139146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=ef49ccaba3e84bc8b1d95d80075e3c65, user.id=7f290bea01f947c1b0f4af9ed8ad92b1) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:35:59.139453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:35:59.140924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0507e8-70ad-4210-aee7-f5fc621aab37 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:35:59.146640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 582/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:35:59 2022] GET /identity/v3/role_assignments?user.id=7f290bea01f947c1b0f4af9ed8ad92b1&scope.project.id=ef49ccaba3e84bc8b1d95d80075e3c65&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:01.289956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff694-13c7-430c-bc8e-240270ee3b0a None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:01.290515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff694-13c7-430c-bc8e-240270ee3b0a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:01.290515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff694-13c7-430c-bc8e-240270ee3b0a None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:01.291892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 580/1162] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:01.296955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df885655-616d-464a-956d-1b569212b6bd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:01.297365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df885655-616d-464a-956d-1b569212b6bd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:01.297511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df885655-616d-464a-956d-1b569212b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:01.314567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-df885655-616d-464a-956d-1b569212b6bd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:01.315735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-df885655-616d-464a-956d-1b569212b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:01.380528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 583/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:01.403400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff694-13c7-430c-bc8e-240270ee3b0a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:01.481916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:01.504287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff694-13c7-430c-bc8e-240270ee3b0a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:01.538997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:01.539748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:01.540245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:01.540475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:01.608604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:01.610045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:01.685905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:01.707909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 581/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:36:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:01.714776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df885655-616d-464a-956d-1b569212b6bd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:01.758433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:01.813757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df885655-616d-464a-956d-1b569212b6bd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:01.849014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:01.849837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:01.850114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:01.850382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:01.857972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:01.859445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5a5271ce-a7ae-4f83-a3f6-9bdd1cd5c6b1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:36:01.873432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:36:01.874688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:36:01.875590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 584/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:36:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:36:01.880724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:01.978692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6477f-8a5e-417c-aadf-b28fc892f50c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:02.012041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:02.012702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:02.012984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:02.013256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:02.013970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:02.014273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:02.015634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bef0e-1d42-496e-8fa6-4199f3c134fb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:02.022914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 582/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jun 15 14:36:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:04.141432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc1a94-0f4d-4e9c-9712-5097623ab54d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:04.141980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc1a94-0f4d-4e9c-9712-5097623ab54d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:04.141980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc1a94-0f4d-4e9c-9712-5097623ab54d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:04.143388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 585/1167] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:04.149954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17f7c-f8a4-4b6c-bd54-ba7e7121a898 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:04.150472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17f7c-f8a4-4b6c-bd54-ba7e7121a898 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:04.150585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17f7c-f8a4-4b6c-bd54-ba7e7121a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:04.166996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c0b17f7c-f8a4-4b6c-bd54-ba7e7121a898 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:04.168219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c0b17f7c-f8a4-4b6c-bd54-ba7e7121a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:04.202863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:04.233356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:04.256201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc1a94-0f4d-4e9c-9712-5097623ab54d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:04.356130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc1a94-0f4d-4e9c-9712-5097623ab54d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:04.357611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:04.390432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:04.391076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:04.391352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:04.391673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:04.392399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:04.393754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f891a3e-e11e-4d38-af5b-61031bb3324f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:04.453694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 586/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Jun 15 14:36:04 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:36:06.630614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13d02-3199-49e1-9145-903f86247c10 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:06.631146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13d02-3199-49e1-9145-903f86247c10 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:06.631265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13d02-3199-49e1-9145-903f86247c10 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:06.632607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 584/1170] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:06.637888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:06.638325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:06.638420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:06.655285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:06.656496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:06.722701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 587/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:06.748005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13d02-3199-49e1-9145-903f86247c10 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:06.848513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13d02-3199-49e1-9145-903f86247c10 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:06.882109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:06.883451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:06.883742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:06.884042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] PATH_INFO: `/v3/domains/5d994507cd4d44119adb8024b3362e8c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:06.894294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=5d994507cd4d44119adb8024b3362e8c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:06.895740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1684-fd83-4cd4-ad54-55444a2ffc4a None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:06.897424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 585/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Jun 15 14:36:06 2022] GET /identity/v3/domains/5d994507cd4d44119adb8024b3362e8c => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:06.903630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:07.005120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:07.013504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ca373-9203-4ab0-b942-5ef3257b74c3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:07.048475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87221010-726f-48a3-b761-3117339ed407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:07.049132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221010-726f-48a3-b761-3117339ed407 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:07.049412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221010-726f-48a3-b761-3117339ed407 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:07.049686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221010-726f-48a3-b761-3117339ed407 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:07.050424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221010-726f-48a3-b761-3117339ed407 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:07.052280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221010-726f-48a3-b761-3117339ed407 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:07.168698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 588/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:36:06 2022] POST /identity/v3/projects => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:36:09.422895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06c59-e17f-415f-b968-76b4ee136389 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:09.423542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06c59-e17f-415f-b968-76b4ee136389 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:09.423645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06c59-e17f-415f-b968-76b4ee136389 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:09.425028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 586/1174] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:09.430603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:09.431047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:09.431162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:09.449317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:09.450529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:09.527767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 589/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:09.556352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06c59-e17f-415f-b968-76b4ee136389 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:09.591162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:09.667829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06c59-e17f-415f-b968-76b4ee136389 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:09.702641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:09.703424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:09.703704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:09.704003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] PATH_INFO: `/v3/domains/5d994507cd4d44119adb8024b3362e8c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:09.705177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5d994507cd4d44119adb8024b3362e8c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:09.706599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938a154-8f1f-48c7-b3b0-42de61ebab51 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:09.708230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 587/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Jun 15 14:36:09 2022] GET /identity/v3/domains/5d994507cd4d44119adb8024b3362e8c => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:36:09.714033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:09.788284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:09.811872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705adc5-cf1c-441e-b973-a0217c2026c0 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:09.845200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:09.845858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:09.846135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:09.846404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:09.847112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:09.848597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd897d8-005f-4e9b-997d-f2f15bcd8d82 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:09.950014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 590/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:36:09 2022] POST /identity/v3/users => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:36:12.103244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a045-f0ec-45b4-b9f6-0d77851af990 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.103784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a045-f0ec-45b4-b9f6-0d77851af990 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.103784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a045-f0ec-45b4-b9f6-0d77851af990 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.105195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 588/1178] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:12.110360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.110754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.110916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.128064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:12.129258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:12.201121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 591/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:12.224905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7a045-f0ec-45b4-b9f6-0d77851af990 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:12.322522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:12.326324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7a045-f0ec-45b4-b9f6-0d77851af990 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:12.359883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:12.360616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.360899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.361174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.372134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:36:12.380015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:36:12.381169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:36:12.382245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 589/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:36:12.387575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:12.443914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:12.484561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e1d9-75b3-4603-80d6-8cd4bcb816fa None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:12.518738 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:12.519409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.519746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.520294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.521300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:12.521666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:12.524056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:12.532192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 592/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:12.541486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:12.642426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab943-aa5c-427d-ba28-a6d92e6460da None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:12.675535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:12.676414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.676693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.676960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] PATH_INFO: `/v3/users/d63fd1db19b94eaa8c88cf10bbece7da` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.689621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] RBAC: Authorizing `identity:get_user(user_id=d63fd1db19b94eaa8c88cf10bbece7da)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:12.691046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:12.692709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 590/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:36:12 2022] GET /identity/v3/users/d63fd1db19b94eaa8c88cf10bbece7da => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:12.698875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:12.817894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb5481-419d-4c7f-84b2-f123a580960e None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:12.840778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:12.852793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:12.853446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:12.853726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:12.853999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:12.923720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:12.925126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:13.022315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 593/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:36:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:13.028591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:13.048008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:13.132019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80246b-4db6-49f1-b13a-4859b630adf7 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:13.166103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:13.166954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:13.167236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:13.167513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] PATH_INFO: `/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:13.168847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9949f032ef64e0fa9b2c37aebad5e1e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:13.170276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb709-ab1d-4f1f-b8b4-561f3e8d4ca0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:13.171996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 591/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:36:13 2022] GET /identity/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:13.178266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:13.201906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:13.279040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2f76b-c34f-4393-97cb-9fbcdaa7a15f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:13.312387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:13.313027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:13.313306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:13.313574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:13.314389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=b9949f032ef64e0fa9b2c37aebad5e1e, user.id=d63fd1db19b94eaa8c88cf10bbece7da) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:13.314695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:13.316241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65b71-f83a-4a01-88ff-b8f69e350a7b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:13.322214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 594/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:36:13 2022] GET /identity/v3/role_assignments?user.id=d63fd1db19b94eaa8c88cf10bbece7da&scope.project.id=b9949f032ef64e0fa9b2c37aebad5e1e&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:15.493230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be5db-8ca3-4e8f-8881-18629a1cb082 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:15.493789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be5db-8ca3-4e8f-8881-18629a1cb082 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:15.493789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be5db-8ca3-4e8f-8881-18629a1cb082 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:15.495183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 592/1186] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:15.500727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:15.501137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:15.501286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:15.517993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:15.519222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:15.591356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 595/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:15.614738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be5db-8ca3-4e8f-8881-18629a1cb082 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:15.703524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:15.719627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be5db-8ca3-4e8f-8881-18629a1cb082 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:15.756043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:15.756755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:15.757041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:15.757412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:15.768281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:36:15.776151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:36:15.777214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:36:15.778239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 593/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:36:15.783682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:15.801086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:15.887672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db072c7-2c4b-4a9f-84ad-9af97b661f95 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:15.921606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:15.922273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:15.922555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:15.922828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:15.923572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:15.923903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:15.925282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:15.934150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 596/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:15.940121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:16.040550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f6f43-df6c-4e79-98ea-e035b152dcb9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:16.073648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:16.074521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:16.074799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:16.075069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] PATH_INFO: `/v3/users/d63fd1db19b94eaa8c88cf10bbece7da` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:16.076282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] RBAC: Authorizing `identity:get_user(user_id=d63fd1db19b94eaa8c88cf10bbece7da)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:16.077975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:16.079783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 594/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:36:15 2022] GET /identity/v3/users/d63fd1db19b94eaa8c88cf10bbece7da => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:16.085616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:16.170014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:16.191774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3aa99-0b41-451e-aba6-835c700bb3e0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:16.226658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:16.227840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:16.228126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:16.228468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] PATH_INFO: `/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:16.229604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] RBAC: Authorizing `identity:get_project(project_id=b9949f032ef64e0fa9b2c37aebad5e1e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:16.231043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a66ef-8b44-4701-8fbb-3b60aad61621 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:16.232794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 597/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:36:16 2022] GET /identity/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:16.238770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:16.255877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:16.340993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547f70-fbd6-4025-a1af-baccb26d8c98 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:16.374274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:16.375160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:16.375441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:16.375716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] PATH_INFO: `/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e/users/d63fd1db19b94eaa8c88cf10bbece7da/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:16.377719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9949f032ef64e0fa9b2c37aebad5e1e, user_id=d63fd1db19b94eaa8c88cf10bbece7da, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:16.379147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e446e-b2d0-47f6-b7af-2d6ba7f3ef47 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:16.486427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 595/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:36:16 2022] PUT /identity/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e/users/d63fd1db19b94eaa8c88cf10bbece7da/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:36:18.598294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60feda-a8ea-44dd-a3aa-d284bbf1de51 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:18.598823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60feda-a8ea-44dd-a3aa-d284bbf1de51 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:18.598823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60feda-a8ea-44dd-a3aa-d284bbf1de51 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:18.600227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 598/1193] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:36:18.605964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:18.606419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:18.606521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:18.622902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:36:18.624119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:36:18.690252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 596/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:36:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:36:18.714380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60feda-a8ea-44dd-a3aa-d284bbf1de51 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:18.815499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60feda-a8ea-44dd-a3aa-d284bbf1de51 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:18.850682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:18.851534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:18.851973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:18.852240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:18.862632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:36:18.870941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:36:18.872120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:36:18.873154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 599/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:36:18.878276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:18.881425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:18.977698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db552-b88b-4e77-815d-10a88917fa06 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:19.010937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:19.011602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:19.011912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:19.012185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:19.012926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:19.013226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:19.014588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:19.023100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 597/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:19.029051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:19.040360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:19.133028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beddeb-f3fc-40fa-9edc-aa4230ac042d None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:19.166659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:19.167518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:19.167792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:19.168089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] PATH_INFO: `/v3/users/d63fd1db19b94eaa8c88cf10bbece7da` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:19.169257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] RBAC: Authorizing `identity:get_user(user_id=d63fd1db19b94eaa8c88cf10bbece7da)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:19.170701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:19.172366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 600/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jun 15 14:36:19 2022] GET /identity/v3/users/d63fd1db19b94eaa8c88cf10bbece7da => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:19.178180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:19.246477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:19.281585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419ca6-90bd-41b0-a26a-2cb292e2b849 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:19.315531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81f35-9f49-473f-a123-65988275644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:19.316213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81f35-9f49-473f-a123-65988275644c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:19.316495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81f35-9f49-473f-a123-65988275644c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:19.316766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81f35-9f49-473f-a123-65988275644c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:19.385251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81f35-9f49-473f-a123-65988275644c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:19.386613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81f35-9f49-473f-a123-65988275644c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:19.451287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:19.488525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 598/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:36:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:19.494556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:19.568988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:19.593703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6075-edef-41ce-83cc-aada531d8539 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:19.627737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:19.628619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:19.628904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:19.629178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] PATH_INFO: `/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:19.630376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] RBAC: Authorizing `identity:get_project(project_id=b9949f032ef64e0fa9b2c37aebad5e1e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:19.631835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67834f4-d60e-4fd5-8eeb-40ec307fd1de None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:19.634002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 601/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jun 15 14:36:19 2022] GET /identity/v3/projects/b9949f032ef64e0fa9b2c37aebad5e1e => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:19.640322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81f35-9f49-473f-a123-65988275644c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:36:19.739160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81f35-9f49-473f-a123-65988275644c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:36:19.773948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:36:19.774599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:36:19.774877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:36:19.775147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:36:19.775996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=b9949f032ef64e0fa9b2c37aebad5e1e, user.id=d63fd1db19b94eaa8c88cf10bbece7da) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:36:19.776303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:36:19.777730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9a5ae-a3d8-404a-8f14-0df7be30af00 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:36:19.783603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 599/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:36:19 2022] GET /identity/v3/role_assignments?user.id=d63fd1db19b94eaa8c88cf10bbece7da&scope.project.id=b9949f032ef64e0fa9b2c37aebad5e1e&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:36:29.623439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=29 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:29.780905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=85 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:35.014384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9653-944c-40ce-8438-d55d5351d044 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:35.014960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9653-944c-40ce-8438-d55d5351d044 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:35.014960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9653-944c-40ce-8438-d55d5351d044 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:35.016252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 602/1201] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:35.021420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:35.021861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:35.021960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:35.040783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:35.043282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:35.109907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 600/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:35.135724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9653-944c-40ce-8438-d55d5351d044 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:35.237675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9653-944c-40ce-8438-d55d5351d044 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:35.272458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:35.273158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:35.273437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:35.273712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:35.284831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:35.286326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:35.304703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:35.306512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:35.307791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:35.307791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:35.307791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:35.307791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:35.307791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 603/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:35.312962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:35.415458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c6e29-154a-45b5-a512-9f17926a7b7d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:35.443476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:35.450036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:35.450697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:35.450979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:35.451255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:35.452054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:35.452360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:35.453728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ceb1c-f688-43f0-b617-cd6bf1aec5d2 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:35.465286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 601/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:35.471033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:35.525138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:35.572132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047893d-9716-461a-bd2c-b4f50bb12502 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:35.605822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:35.606487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:35.606766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:35.607038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:35.607740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:35.609214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93dde9-e9c7-4d8e-9e0a-d9dd165d88ff None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:35.677714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 604/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jun 15 14:37:35 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:37:37.865347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cb880-e046-449a-9c94-fed009d78f0c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:37.866062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cb880-e046-449a-9c94-fed009d78f0c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:37.866062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cb880-e046-449a-9c94-fed009d78f0c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:37.867334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 602/1206] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:37.873333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:37.873731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:37.873885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:37.890722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:37.891969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:37.957779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 605/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:37.982261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cb880-e046-449a-9c94-fed009d78f0c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.085214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cb880-e046-449a-9c94-fed009d78f0c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.117875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.119341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.119621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.119917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.130211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:38.138457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:38.139576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:38.140493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 603/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:37:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:38.145876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.184515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:38.242953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5dc01-ae37-493f-82af-c3d4b1080187 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.278179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:38.282839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:38.290743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 606/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:38.296420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.349001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:38.398180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8483d8-1d26-47f7-8777-599fc03a0ca0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.432662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.433482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.433760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.434030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.444180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:38.445757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:38.463137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:38.464263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:38.465369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:38.465369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:38.465369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:38.465369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:38.465369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 604/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:38.470278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.569544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:38.572590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6ffd-c0df-43c2-8340-e9432f51360f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.606237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.606936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.607181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.607457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.608215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:38.608522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:38.609894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:38.622115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 607/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:38.627927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.726171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c58b-3f42-4bf8-8f8d-c202e191d305 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.728497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:38.762172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.762950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.763229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.763501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.770709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:38.772172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:37:38.788743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:38.789938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:38.791639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 605/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:38.796484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:38.896728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb75b-0174-4111-88e2-87ad7043354c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:38.929734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:38.930399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:38.931307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:38.931586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:38.932449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:38.932756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:38.934263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:38.951962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 608/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:38.958123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:39.059974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c453b-ebac-43f3-b160-9f9df9522b26 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:39.094139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:39.094777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:39.095054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:39.095324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:39.124411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:39.161549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:39.162914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:39.261304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 606/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:37:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:37:39.267274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:39.286461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:39.367479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa27a5-4755-4b84-a4d1-3c1f077e9fa0 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:39.402589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:39.403363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:39.403641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:39.403939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:39.414092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:39.415557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:39.433164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:39.435091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:39.436370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:39.436370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:39.436370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:39.436370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:39.436370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 609/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:39.440167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:39.500924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:39.539201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc584ce-adaf-45fc-9c1b-85f3f6759149 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:39.584134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:39.584803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:39.585088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:39.585367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:39.586093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:39.586398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:39.588537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:39.599718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 607/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:39.606351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:39.675702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:39.713152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0654001-dbb5-427f-bd5a-c43a327740bf None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:39.747622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:39.748464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:39.748749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:39.749026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:39.756189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:39.758104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:37:39.773300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:39.774942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:39.775976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 610/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:39.781033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:39.882282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64340ad-7cac-4589-a855-40b5ae87a485 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:39.906354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:39.918316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:39.918977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:39.919259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:39.919533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:39.920355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:39.920666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:39.922250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977ef49-8695-452a-a421-65542fb23e89 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:39.934906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 608/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:39.941104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:40.041368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908db-d331-4385-9816-0f444bb406a2 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:40.069508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:40.075408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:40.076083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:40.076361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:40.076628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:40.077452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=af660e04a05a45cfa3db0713712ddc9f) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:40.077759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:40.079275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5754c-b630-4997-9767-01dcbecfb430 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:40.084925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 611/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:37:39 2022] GET /identity/v3/role_assignments?user.id=af660e04a05a45cfa3db0713712ddc9f&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:42.196367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c1a-12c5-40ce-9859-155145db1d91 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.197013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c1a-12c5-40ce-9859-155145db1d91 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.197013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c1a-12c5-40ce-9859-155145db1d91 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.198274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 609/1220] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:42.203814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.206722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.206722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.221286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:42.222504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:42.289771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 612/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:42.314377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520c1a-12c5-40ce-9859-155145db1d91 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:42.421518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520c1a-12c5-40ce-9859-155145db1d91 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:42.457879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:42.458596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.458881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.459158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.470376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:42.478190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:42.479942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:42.480820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 610/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:42.485711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:42.587625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b88e0-340e-4c7d-b5b4-8e5da1ec0057 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:42.611181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:42.621751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:42.622418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.622701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.622978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.623723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] RBAC: Adding query filter params (name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:42.624063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:42.625480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:42.633267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 613/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:42.639241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:42.684113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:42.741100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8917ec-cb1f-44f0-861b-52befdc8acbb None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:42.774248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:42.775528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.775832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.776141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.786364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:42.787865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:42.806498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:42.807618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:42.808794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:42.808794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:42.808794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:42.808794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:42.808794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 611/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:37:42.813708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:42.916427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1f03-a6d2-4aff-a0f1-331d08561931 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:42.949881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:42.950529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:42.950808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:42.951079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:42.951798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:42.952138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:42.953506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:42.965265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 614/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:42.971127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.067835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:43.074425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656765e-6012-4b6f-a1cb-abc260e858ad None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.108961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.109766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.110051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.110325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.117643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.119883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:37:43.133957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:43.135606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:43.136605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 612/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:43.141318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.188846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:43.242687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38500c5-5c4f-4df7-9e11-d428dc777d63 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.278414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.300601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 615/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:37:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:43.307169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.407784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d676-df92-4752-a23f-aa85a9092ec4 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.441276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.442081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.442349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.442625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.454290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.456042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:43.473379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:43.474440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:43.475547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:43.475547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:43.475547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:43.475547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:43.475547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 613/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:43.480669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.581784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad8ce-8360-41b9-b2fb-9b048c6ddf6f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.584189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:43.616089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.616749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.617021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.617289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.618263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:43.618586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.620277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.631499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 616/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:43.637948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.647400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:43.739418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e497-d333-4f1f-bf86-871f7fe1b97c None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.772860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.773702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.773986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.774261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.781881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.783726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:37:43.799053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:43.800202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:43.813377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 614/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:43.813992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:43.925394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088f495-4c7f-4818-892d-90ac259e4dca None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:43.960067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:43.960732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:43.961023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:43.961299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:43.962132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:43.962441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:43.963903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8ea76-66d4-4a0d-b38a-49f2d003b114 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:43.975924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 617/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:43.982901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:44.048589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:44.082389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393511-9847-4302-8733-3526ba4aae9b None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:44.117540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:44.118448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:44.118744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:44.119084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/af660e04a05a45cfa3db0713712ddc9f/roles/447a2ba1c68542a685c9617a06b29eac` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:44.133143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=af660e04a05a45cfa3db0713712ddc9f, role_id=447a2ba1c68542a685c9617a06b29eac)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:44.134810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9ac0-1946-4fbf-acba-52420e500216 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:44.210270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 615/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:37:43 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/af660e04a05a45cfa3db0713712ddc9f/roles/447a2ba1c68542a685c9617a06b29eac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:37:46.343006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336050-1374-46bd-9b00-6e7ad3ebd8b7 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:46.343536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336050-1374-46bd-9b00-6e7ad3ebd8b7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:46.343536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336050-1374-46bd-9b00-6e7ad3ebd8b7 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:46.344961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 618/1233] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:46.350101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:46.350546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:46.350639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:46.366667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:46.367877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:46.435275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 616/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:46.459253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336050-1374-46bd-9b00-6e7ad3ebd8b7 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:46.483906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:46.558634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336050-1374-46bd-9b00-6e7ad3ebd8b7 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:46.593188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:46.594024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:46.594310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:46.594588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:46.606187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:46.615666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:46.616799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:46.617902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 619/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jun 15 14:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:46.621524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:46.668578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:46.720922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd558869-50bf-4f78-8376-722f3544d2d6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:46.755389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:46.758649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:46.758649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:46.758649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:46.758649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] RBAC: Adding query filter params (name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:46.758649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:46.759229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:46.767619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 617/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jun 15 14:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:46.773525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:46.863254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:46.878883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f552-c189-4d03-8bee-7d70d0e7b5b1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:46.913099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:46.913886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:46.914186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:46.914448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:46.924946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:46.926400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:46.944403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:46.945340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:46.947653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:46.947653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:46.947653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:46.947653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:46.947653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 620/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:46.952160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:47.050247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b215-5e2b-4fd9-b1ca-545755fec1bf None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:47.062028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:47.086559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:47.087243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:47.087520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:47.087812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:47.088837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:47.089325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:47.091006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:47.102400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 618/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:47.108189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:47.208660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212342c-4f1a-4b21-8d56-1e5abfbc56d9 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:47.241983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:47.242772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:47.243050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:47.244000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] PATH_INFO: `/v3/users/placement` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:47.246960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:47.251510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:47.253007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:37:47.268034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:47.269167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:47.270299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 621/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:47.275571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:47.376603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e654-019f-464a-93cf-203b6c561b54 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:47.410135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:47.410794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:47.411078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:47.411354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:47.412213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:47.412521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:47.413946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:47.433205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 619/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:37:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:47.438965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:47.541968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b4af-0438-4a2e-8fd7-8a142c4cdacd None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:47.577729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:47.578375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:47.578652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:47.578922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:47.642317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:47.651389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:47.652884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:47.751965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 622/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:37:47.757856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:47.785608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:47.859159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862c86-02e1-48ed-b2ff-1e9d21f695f9 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:47.893664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:47.894461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:47.894744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:47.895020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:47.906551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:47.908037 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:47.925985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:47.927034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:47.928121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:47.928121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:47.928121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:47.928121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:47.928121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 620/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:47.933432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:48.028524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:48.034209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b308e-7570-4bf5-9211-7e2a1d520cc7 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:48.067449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:48.068144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:48.068428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:48.068705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:48.069434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:48.069740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:48.071118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:48.082977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 623/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:48.089342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:48.171681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:48.192010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f033-954a-4004-bc3a-806f1ec89c86 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:48.226542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:48.227326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:48.228196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:48.228660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:48.238810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:48.240350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:37:48.255175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:48.256538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:48.257647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 621/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:48.262345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:48.360798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08722aa7-38bf-4c2f-af70-b894264d8d14 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:48.395041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:48.395699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:48.396002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:48.396275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:48.397057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:48.397359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:48.399035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b34c-0070-4bd2-b7df-697868bd54e7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:48.412746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 624/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:48.419044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:48.520703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbbc0e-39e3-4c1c-b032-e73d73d229b8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:48.555294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6136471-b503-4214-a269-af566be57f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:48.556732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136471-b503-4214-a269-af566be57f24 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:48.557014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136471-b503-4214-a269-af566be57f24 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:48.557288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136471-b503-4214-a269-af566be57f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:48.558124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6136471-b503-4214-a269-af566be57f24 None admin] RBAC: Adding query filter params (role.id=447a2ba1c68542a685c9617a06b29eac, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=af660e04a05a45cfa3db0713712ddc9f) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:48.558438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6136471-b503-4214-a269-af566be57f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:48.559903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6136471-b503-4214-a269-af566be57f24 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:48.565830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 622/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:37:48 2022] GET /identity/v3/role_assignments?user.id=af660e04a05a45cfa3db0713712ddc9f&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=447a2ba1c68542a685c9617a06b29eac => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:50.798073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9bf6-a9e8-4966-b2f0-1f144f18c99a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:50.798621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9bf6-a9e8-4966-b2f0-1f144f18c99a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:50.798715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9bf6-a9e8-4966-b2f0-1f144f18c99a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:50.800122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 625/1247] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:50.805395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:50.811128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:50.811128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:50.811504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:50.824364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:50.825577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:50.893047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 623/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:50.916604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf9bf6-a9e8-4966-b2f0-1f144f18c99a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:50.935508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:51.021022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf9bf6-a9e8-4966-b2f0-1f144f18c99a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.055436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.056323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.056631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.056910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.066764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:51.074534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:51.075656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:51.076594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 626/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:51.082058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:51.181146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625547b-60d6-4a44-bbd7-14c10606f84a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.211178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:51.216841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.217507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.217791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.218067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.218813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:51.219125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:51.220520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:51.228553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 624/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:51.234382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:51.312548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:51.335508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363093-f024-4ec3-9d5b-3f8376370b7c None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.369539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.370328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.370609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.370882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.381487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:51.382952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:51.400192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:51.401315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:51.407266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:51.407266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:51.407266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:51.407266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:51.407266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 627/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:51.407673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:51.511650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348b7f-8521-4a38-a7c5-e027154b56be None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.545785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.546447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.546726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.546999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.547721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:51.548050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:51.549444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:51.562162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 625/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:51.568188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:51.669624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1740-fb12-4587-a40a-5731d96230ff None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.695413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:51.704261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.705324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.705604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.705885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.713794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:51.715253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:37:51.729663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:51.730837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:51.732460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 628/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:51.736788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:51.792885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:51.837613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f1d1-f2cb-4aed-b1a1-4dd50b2dda02 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:51.871286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:51.871994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:51.872524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:51.873321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:51.874248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:51.874555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:51.876022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:51.894066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 626/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:51.900058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.004601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b494f-6681-4fcf-9cf0-11ca86c43898 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:52.038886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:52.039528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:52.039833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:52.040156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:52.096661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:52.108746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:52.110223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:52.207856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 629/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:37:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:37:52.213823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.313924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffa93-f6b7-42fa-9b17-9ac5ce8401da None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:52.327235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:52.348577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:52.349428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:52.349717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:52.349994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:52.361197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:52.362703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:52.380665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:52.384358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:52.385557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:52.385557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:52.385557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:52.385557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:52.385557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 627/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:52.388108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.474512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:52.486654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c7d1-6974-4f26-8ef3-6d6fdc035fbc None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:52.520796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:52.521456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:52.521733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:52.522066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:52.522787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:52.523094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:52.524535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:52.535729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 630/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:52.541562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.644150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7042-0325-477a-b3ca-6c57520be542 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:52.678044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:52.678828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:52.679112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:52.679390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:52.686207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:52.687659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:37:52.702041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:52.703095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:52.704328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 628/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:52.709661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.813283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfae2-f30b-446f-a434-1a8b0fcc8098 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:52.847693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:52.848379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:52.848664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:52.848941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:52.849727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:52.850039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:52.851479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ba1d-9a13-40bf-a193-f009036bafc6 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:52.864365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 631/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:52.870811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:52.897673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:52.974271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee135ed-a6cc-4413-9c95-567815c082ca None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:53.008362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:53.009515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:53.009800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:53.010072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:53.010918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=af660e04a05a45cfa3db0713712ddc9f) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:53.011225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:53.012666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2393c0-867e-487a-9303-6002ac2e0b19 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:53.018356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 629/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:37:52 2022] GET /identity/v3/role_assignments?user.id=af660e04a05a45cfa3db0713712ddc9f&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:55.124871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bccd-7a35-41ec-bc28-b17496be40c3 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.125403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bccd-7a35-41ec-bc28-b17496be40c3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.125514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bccd-7a35-41ec-bc28-b17496be40c3 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.126842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 632/1261] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:55.132328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.132849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.132983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.151902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:55.153141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:55.225411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 630/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:37:55.254387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63bccd-7a35-41ec-bc28-b17496be40c3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:55.266629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:55.361695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63bccd-7a35-41ec-bc28-b17496be40c3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:55.399342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721025-2649-49d9-b400-7b530100f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:55.400643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721025-2649-49d9-b400-7b530100f854 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.400915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721025-2649-49d9-b400-7b530100f854 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.401184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721025-2649-49d9-b400-7b530100f854 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.411950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02721025-2649-49d9-b400-7b530100f854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-02721025-2649-49d9-b400-7b530100f854 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:55.420251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:55.421293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:55.422187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 633/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:55.427712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:55.448501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:55.534099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8a84-9d9d-4fb1-a001-7f5d7d553602 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:55.572256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:55.573243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.573505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.573776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.574635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:55.574937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:55.576351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:55.585327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 631/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:55.592109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721025-2649-49d9-b400-7b530100f854 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:55.662528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:55.700688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721025-2649-49d9-b400-7b530100f854 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:55.735617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:55.736453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.736734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.737008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.749279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:55.750854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:55.769122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:55.770730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:55.772246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:55.772246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:55.772246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:55.772246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:55.772246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 634/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:55.776631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:55.864845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:55.885618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1e558-72da-4f5c-92dd-95f0f622cb83 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:55.920531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:55.921115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:55.921391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:55.921705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:55.922425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:55.922723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:55.924153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:55.937467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 632/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:55.943252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.063874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340cce-e62c-4f38-8918-648e1e3360be None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.086438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:56.101334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.102133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.102415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.102725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.110614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.112103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:37:56.127498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:56.129031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:56.130001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 635/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:56.135687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.241470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22459d0-c6d2-434e-8928-0a2de12354b5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.277380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.278048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.278330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.278607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.279448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:56.279753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.281345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:56.290581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:56.299122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 633/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:37:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:56.304974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.418760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551b9e-1264-4d54-8f5c-baf8f6b69469 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.456704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.457500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.457776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.458045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.469584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.471107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:56.488215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:56.498524 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:56.499566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:56.499566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:56.499566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:56.499566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:56.499566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 636/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 14:37:56.499893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.600647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf4f5-bbe5-41f8-9661-7a7a76001e63 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.642062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.642723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.643003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.643273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.644027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:56.644333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.645768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:56.657498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 634/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:56.663073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.704672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:56.776385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a1878-46bc-4b30-81d6-b34d0cf2193b None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.810912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.811787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.812089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.812363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.819517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.821005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:37:56.836029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:56.837550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:37:56.838517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 637/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:56.843303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:56.909820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:56.952485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5a00-35a6-437b-8e7b-26bd757d27d8 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:56.992955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:56.994231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:56.994474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:56.994729 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:56.995560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:56.995890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:56.997344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f37f-7c06-4366-913d-359eef5eda59 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:57.010271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 635/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:57.016432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:57.116022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:57.124896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b2bf-44b8-448b-9019-253744157219 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:57.161301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:57.162273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:57.162546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:57.162818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] PATH_INFO: `/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/af660e04a05a45cfa3db0713712ddc9f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:57.164843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff3430f8f94c209683f9eff4724b35, user_id=af660e04a05a45cfa3db0713712ddc9f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:57.166334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c6192-a572-44cf-b2ff-2ca9fa944ef7 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:57.245631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 638/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jun 15 14:37:57 2022] PUT /identity/v3/projects/98ff3430f8f94c209683f9eff4724b35/users/af660e04a05a45cfa3db0713712ddc9f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:37:59.361663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da3ac-347f-410f-836c-ae06e8e405e1 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:59.362269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da3ac-347f-410f-836c-ae06e8e405e1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:59.362269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da3ac-347f-410f-836c-ae06e8e405e1 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:59.363660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 636/1274] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:37:59.370013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:59.371290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:59.371290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:59.389086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:37:59.394255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:37:59.459019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 639/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 14:37:59.483043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27da3ac-347f-410f-836c-ae06e8e405e1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:59.586369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27da3ac-347f-410f-836c-ae06e8e405e1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:59.605189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:59.622656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:59.623370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:59.623651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:59.623955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:59.634206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 14:37:59.641864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:59.642998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:59.644141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 637/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jun 15 14:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:59.649092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:59.729896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:59.748640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3a5c-586c-4106-ad3f-32576bb56c6e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:59.783213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:59.783910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:59.784198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:59.784478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:59.785285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:37:59.785595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:59.786978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:59.796191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 640/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jun 15 14:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:37:59.801835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:37:59.909110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a87b9-352c-41be-aee3-032a92719335 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:37:59.943022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:37:59.943838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:37:59.944119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:37:59.944404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:37:59.956128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:37:59.957619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:37:59.975869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:37:59.977115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:37:59.978797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:37:59.978797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:37:59.978797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:37:59.978797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:37:59.978797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 638/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:37:59.983613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:00.097175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46f39-c856-4e5d-827b-cd1aac21a89f None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:00.132208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:00.132867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:00.133148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:00.133421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:00.134843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:00.135165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:00.136667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:00.148475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 641/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:00.154617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:00.188813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:00.255613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e679ca1-84e3-44f0-91db-5ce118d3551f None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:00.289771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:00.290682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:00.290966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:00.291238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:00.299480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:00.300957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 14:38:00.315066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:00.316252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:00.317623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 639/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:38:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:00.323018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:00.326777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:00.424480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a974-4b9f-4f68-a885-0d5bf3855625 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:00.458557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:00.459160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:00.459444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:00.459724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:00.460595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:00.460903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:00.462966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:00.480685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 642/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jun 15 14:38:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:00.486622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:00.578940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:00.589264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb065949-25e6-40b2-b03a-4e910be5b9aa None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:00.621812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:00.622447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:00.622731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:00.623004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:00.690127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:00.691565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:00.785391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:00.796508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 640/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jun 15 14:38:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 14:38:00.802636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:00.866540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:00.905230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e6d77-e6ac-4c8d-9ad8-6b34566a7ec1 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:00.939177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:00.939996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:00.940274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:00.940547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:00.951825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:00.953283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 14:38:00.970744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:00.971722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:00.972677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 14:38:00.972677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 14:38:00.972677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 14:38:00.972677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:38:00.972677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 643/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:00.977734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:01.077763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c48e-15e6-44c5-b43e-7955312d7d50 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:01.112858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:01.113547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:01.113828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:01.114110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:01.114832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:01.115136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:01.116590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:01.128608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 641/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jun 15 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:01.134470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:01.234275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174e1e-ecfb-4d55-b7b1-c959a0538a18 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:01.248492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:01.267769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:01.268578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:01.272526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:01.272526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:01.276227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:01.277679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 14:38:01.292102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:01.293161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: ERROR keystone.server.flask.application Jun 15 14:38:01.294413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 644/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jun 15 14:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:01.299066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:01.350212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:01.399496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae96c43-55ca-417f-b490-c5b3e2524ce0 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:01.432843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:01.433499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:01.433787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:01.434067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:01.434856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:01.435164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:01.436633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be0f04-6e64-448e-8f88-796b82ad9641 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:01.448504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 642/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jun 15 14:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:01.454667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:01.554536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9a5c7-768a-4dbc-b7d4-1b1778f7f136 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:01.587859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:01.588611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:01.588918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:01.589192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:01.590018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] RBAC: Adding query filter params (role.id=a897d8f9c9c2436fba6b0c44a5f6bb07, scope.project.id=98ff3430f8f94c209683f9eff4724b35, user.id=af660e04a05a45cfa3db0713712ddc9f) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:01.590347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:01.591773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e4eb-acf8-43ef-a4cc-a1c7b0d56bb2 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:01.597605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 645/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jun 15 14:38:01 2022] GET /identity/v3/role_assignments?user.id=af660e04a05a45cfa3db0713712ddc9f&scope.project.id=98ff3430f8f94c209683f9eff4724b35&role.id=a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:03.765552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae8e8-531f-418c-8b44-2bdcd6eab49d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:03.766055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae8e8-531f-418c-8b44-2bdcd6eab49d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:03.766158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae8e8-531f-418c-8b44-2bdcd6eab49d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:03.767489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 643/1288] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:38:03.772781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:03.773211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:03.773339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:03.791148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:38:03.792351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:38:03.821649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:03.858677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 646/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:38:03.881076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edae8e8-531f-418c-8b44-2bdcd6eab49d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:03.983866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edae8e8-531f-418c-8b44-2bdcd6eab49d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:03.996060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:04.018661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:04.019482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:04.019766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:04.020070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:04.020730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:04.022103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:04.034550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:04.035647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:04.036603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 644/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:38:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:04.042526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:04.140715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f0ff0-77c0-4927-bdb0-afa4cc6592db None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:04.174483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:04.175138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:04.175415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:04.175687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:04.176419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:04.176722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:04.178085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020f-ca18-4940-b515-6b5c28ec70a8 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:04.183396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 647/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jun 15 14:38:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:04.189330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:04.289252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf0fa-b51b-4cbf-a725-9a6fa8a7ac47 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:04.323079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:04.323746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:04.324061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:04.324341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] PATH_INFO: `/v3/services` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:04.325057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] RBAC: Adding query filter params (type=placement) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:04.325365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:04.326742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63e4a-299d-469a-b383-a3d3675c6e4b None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:04.331647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 645/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jun 15 14:38:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:06.454873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308ea1-2388-4876-881e-69f737686551 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:06.455667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308ea1-2388-4876-881e-69f737686551 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:06.455667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308ea1-2388-4876-881e-69f737686551 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:06.457151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 648/1293] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:38:06.463081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439a5d0-25c1-4241-8dfe-1051820703e8 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:06.463650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439a5d0-25c1-4241-8dfe-1051820703e8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:06.463650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439a5d0-25c1-4241-8dfe-1051820703e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:06.480170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5439a5d0-25c1-4241-8dfe-1051820703e8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:38:06.481348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5439a5d0-25c1-4241-8dfe-1051820703e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:38:06.510580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:06.548061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 646/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:38:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:38:06.573994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308ea1-2388-4876-881e-69f737686551 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:06.606127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:06.675102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308ea1-2388-4876-881e-69f737686551 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:06.710270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:06.710270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:06.710270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:06.710270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:06.710972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:06.712930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f63d-9bae-417b-9a7a-1730d19deb8d None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:06.793924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 649/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jun 15 14:38:06 2022] POST /identity/v3/services => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:38:08.975249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11435b08-7542-42f3-9bcd-393d09eee0ae None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:08.975825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11435b08-7542-42f3-9bcd-393d09eee0ae None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:08.975825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11435b08-7542-42f3-9bcd-393d09eee0ae None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:08.977211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 647/1296] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:38:08.982896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:08.983306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:08.983407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:09.001281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:38:09.002487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:38:09.075378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 650/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:38:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:38:09.098647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11435b08-7542-42f3-9bcd-393d09eee0ae None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:09.197613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11435b08-7542-42f3-9bcd-393d09eee0ae None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:09.231534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:09.232355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:09.232639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:09.232961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:09.233569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:09.234936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:09.247279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:09.248562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:09.249429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 648/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:38:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:09.254693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:09.273213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:09.358830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e612-b8ab-430f-9b55-3f3099bed2ad None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:09.401433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:09.402103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:09.402386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:09.402666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:09.403376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:09.403701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:09.405127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:09.410503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 651/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jun 15 14:38:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:09.418324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:09.451127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:09.519070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc994fa-18d3-4d03-b7c3-e55a054677f5 None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:09.552423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:09.553078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:09.553359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:09.553633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:09.554417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] RBAC: Adding query filter params (interface=public, service_id=726511bfd5684b5c81a273b0507cb6a7, region_id=RegionOne) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:09.554722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:09.556881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b320a-3d18-4a63-b555-a1331e6b61fb None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:09.562031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 649/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jun 15 14:38:09 2022] GET /identity/v3/endpoints?service_id=726511bfd5684b5c81a273b0507cb6a7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:09.568250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:09.652212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:09.669893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb912f-f247-4df5-996b-f8ba8bf1ad26 None admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:09.705773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:09.706434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:09.706707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:09.706972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:09.707797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:09.709190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a2829-7646-4c71-9a0a-d2777e1f883f None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:09.716528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 652/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jun 15 14:38:09 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:38:11.986701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6050-98af-4263-b2bb-df6032361ca7 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:11.987213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6050-98af-4263-b2bb-df6032361ca7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:11.987213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6050-98af-4263-b2bb-df6032361ca7 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:11.988622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 650/1302] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:38:11.994413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:11.994994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:11.994994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:12.012338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:38:12.013547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:38:12.082172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 653/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:38:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 14:38:12.107012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f6050-98af-4263-b2bb-df6032361ca7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:12.203499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:12.210604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f6050-98af-4263-b2bb-df6032361ca7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:12.246575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:12.247299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:12.247584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:12.247888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] PATH_INFO: `/v3/services/placement` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:12.248547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:12.249916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 14:38:12.262089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 14:38:12.263370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application with Lock( Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self._enter() Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application return self.creator() Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application created_value = creator( Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: ERROR keystone.server.flask.application Jun 15 14:38:12.273895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 651/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jun 15 14:38:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 14:38:12.274982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:12.345873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:12.368659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c351de1-d6c9-45ee-8fb2-4a049fad645e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:12.403834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:12.404513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:12.404797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:12.405073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] PATH_INFO: `/v3/services` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:12.405780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:38:12.406088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:12.407472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319719e2-15f9-4072-98c5-dab1c31ac969 None admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:12.412819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 654/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jun 15 14:38:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:38:12.419360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:38:12.519727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea211-f832-4734-a490-bc6cbebdcaaa None admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:38:12.554056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:38:12.554728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:38:12.554993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:38:12.555266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:38:12.556040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:38:12.557843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ae7b-46ad-4a8f-af98-ffe3d51b4011 None admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:38:12.661370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 652/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jun 15 14:38:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:38:22.409699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=30 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:38:22.656638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:00.469801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c072-a291-48cb-a679-41d15bbb7a17 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:00.470366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c072-a291-48cb-a679-41d15bbb7a17 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:00.470818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c072-a291-48cb-a679-41d15bbb7a17 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:00.473714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 655/1307] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:00.483351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777ddc-3682-4d3f-b854-b3e25e7d213c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:00.483926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777ddc-3682-4d3f-b854-b3e25e7d213c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:00.484399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777ddc-3682-4d3f-b854-b3e25e7d213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:00.621299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1f777ddc-3682-4d3f-b854-b3e25e7d213c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:00.622525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1f777ddc-3682-4d3f-b854-b3e25e7d213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:00.795883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 653/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:00.861729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:00.862086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:00.862669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:00.864488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 656/1309] 10.222.0.49 () {54 vars in 964 bytes} [Wed Jun 15 14:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:00.873648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7cabb-e35e-4743-a46d-0a4ce146bb8b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:00.873913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7cabb-e35e-4743-a46d-0a4ce146bb8b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:00.874317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7cabb-e35e-4743-a46d-0a4ce146bb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:00.966427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-48d7cabb-e35e-4743-a46d-0a4ce146bb8b None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:00.967870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-48d7cabb-e35e-4743-a46d-0a4ce146bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:00.996201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:01.078113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 654/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Jun 15 14:45:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:01.088436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:01.090240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:01.306713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642389f5-a5cd-4060-b293-8cfa0bd07cb9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:01.447660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:01.448990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:01.449665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:01.449892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:01.453664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:01.580174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:01.680005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:01.684489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbb5a-dd85-4ee9-b205-c7b54e9324ce service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:01.728516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 657/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:04.277199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1824d8-ccdd-4ae5-9eaa-9f06d7e6dbe2 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:04.278031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1824d8-ccdd-4ae5-9eaa-9f06d7e6dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:04.278031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1824d8-ccdd-4ae5-9eaa-9f06d7e6dbe2 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:04.279161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 655/1312] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:04.285020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f48e-0f44-4c11-9660-ca681298a663 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:04.285788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f48e-0f44-4c11-9660-ca681298a663 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:04.285788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f48e-0f44-4c11-9660-ca681298a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:04.366838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-63f3f48e-0f44-4c11-9660-ca681298a663 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:04.368086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-63f3f48e-0f44-4c11-9660-ca681298a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:04.483247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 658/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:45:04.536928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:04.537210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:04.537478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:04.538981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 656/1314] 10.222.0.49 () {54 vars in 964 bytes} [Wed Jun 15 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:04.546645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f88668-1da0-4c1e-8e7e-8d4828f13a74 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:04.546985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f88668-1da0-4c1e-8e7e-8d4828f13a74 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:04.547271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f88668-1da0-4c1e-8e7e-8d4828f13a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:04.559113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:04.637937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d6f88668-1da0-4c1e-8e7e-8d4828f13a74 None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:04.639216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d6f88668-1da0-4c1e-8e7e-8d4828f13a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:04.753827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 659/1315] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Jun 15 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:04.768499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:04.770042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:04.911026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5085d-1ee9-4c88-af2b-8ecd1026c622 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:04.989561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:04.992263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:04.992918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:04.993242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:04.993556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:04.995986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:05.114747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:05.116237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ec5d5-b836-49b7-99d8-48e86ce533a2 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:05.135998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 657/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:45:08.131272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:08.132173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:08.132173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:08.134438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 660/1317] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:45:08.140603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e03f-e71f-45e3-b13e-9e5ca6dcb97b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:08.141168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e03f-e71f-45e3-b13e-9e5ca6dcb97b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:08.141168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e03f-e71f-45e3-b13e-9e5ca6dcb97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:08.214172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c7f9e03f-e71f-45e3-b13e-9e5ca6dcb97b None None] MFA Rules not processed for user `2827b6c15de64c1f9dea12ca5ccd48ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:08.215425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c7f9e03f-e71f-45e3-b13e-9e5ca6dcb97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:08.280201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:08.350975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 658/1318] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:45:08.392781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:08.394468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:08.512133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa037-3ae4-4ef3-a309-7bc2b7032c29 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:08.516334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:08.636644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:08.637499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:08.637960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:08.638542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:08.641810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:08.791706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:08.793199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d725ce-47c8-4425-bd6f-1e9e09136d60 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:08.814203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 661/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:45:12.115175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:12.115857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:12.115857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:12.117324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 659/1320] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:12.124124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc9eec-0ce9-4b93-abe1-931eda4825c9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:12.124722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc9eec-0ce9-4b93-abe1-931eda4825c9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:12.124722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc9eec-0ce9-4b93-abe1-931eda4825c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:12.171887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:12.201454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6acc9eec-0ce9-4b93-abe1-931eda4825c9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:12.202765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6acc9eec-0ce9-4b93-abe1-931eda4825c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:12.320249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 662/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:12.361607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:12.363206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:12.478732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaac69-5de4-45cf-995b-5533afdff51a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:12.559507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:12.560192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:12.560477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:12.560751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:12.562465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:12.570873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:12.686548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:12.688023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71815f8c-2892-47ce-818e-0763b5cd68d1 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:12.708084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 660/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:16.594206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:16.594759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:16.594759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:16.596376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 663/1323] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:45:16.604073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2bc3-d3d1-40cf-9a61-dfd5e972daf3 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:16.604741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2bc3-d3d1-40cf-9a61-dfd5e972daf3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:16.605257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2bc3-d3d1-40cf-9a61-dfd5e972daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:16.699271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-763d2bc3-d3d1-40cf-9a61-dfd5e972daf3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:16.700549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-763d2bc3-d3d1-40cf-9a61-dfd5e972daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:16.773978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:16.824029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 661/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:16.863012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:16.864710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:16.991293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91135e-1fb0-4520-9aa6-2b1372e58f02 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:17.007729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:17.087708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:17.088438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:17.088716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:17.088983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:17.090873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:17.223380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:17.224881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e217-4733-4bff-8907-f24454b22b98 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:17.246924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 664/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:19.788387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:19.791681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:19.791681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:19.791681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 662/1326] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:45:19.798167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ba06-c208-4120-9813-529604f8c099 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:19.798913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ba06-c208-4120-9813-529604f8c099 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:19.800590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ba06-c208-4120-9813-529604f8c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:19.896821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:19.923946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-66e0ba06-c208-4120-9813-529604f8c099 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:19.925868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-66e0ba06-c208-4120-9813-529604f8c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:20.094024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 665/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:20.131381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:20.133013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:20.266518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed3ab-f6be-440c-a044-abe2b47dcdec None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:20.368357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:20.369086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:20.369460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:20.369902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:20.372268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:20.395172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:20.551145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:20.552636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1b4dc-2a06-4af6-8da3-d55af0231fba service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:20.573853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 663/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:45:22.859228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:22.859863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:22.860122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:22.862466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 666/1329] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:22.872316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92760bec-dda8-4927-b461-284f6ad02ad2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:22.872895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92760bec-dda8-4927-b461-284f6ad02ad2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:22.873194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92760bec-dda8-4927-b461-284f6ad02ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:22.991896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-92760bec-dda8-4927-b461-284f6ad02ad2 None None] MFA Rules not processed for user `2827b6c15de64c1f9dea12ca5ccd48ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:22.994226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-92760bec-dda8-4927-b461-284f6ad02ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:23.096460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:23.137484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 664/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:23.184669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:23.187489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:23.349278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d464f-309e-4aa4-b780-e1d3d98b7782 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:23.381192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:23.463063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:23.463399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:23.463700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:23.464204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:23.466351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:23.614139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:23.615618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da91ed1-d00c-4cae-8af0-f9bfd8a86646 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:23.637406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 667/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:26.499063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:26.499745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:26.499745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:26.501346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 665/1332] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:26.507404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766856-7d9b-45a8-b6a0-fea72351efb2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:26.508100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766856-7d9b-45a8-b6a0-fea72351efb2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:26.508100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766856-7d9b-45a8-b6a0-fea72351efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:26.580658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:26.584969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4b766856-7d9b-45a8-b6a0-fea72351efb2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:26.587541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4b766856-7d9b-45a8-b6a0-fea72351efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:26.702789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 668/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:45:26.740743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:26.743072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:26.935229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6baa2-61d6-4f5c-84f2-43b04ee76d90 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:27.054071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:27.055089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:27.055448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:27.055946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:27.057745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:27.089498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:27.188594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:27.190131 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c89e60-168f-44f6-b94e-d413297e7df4 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:27.212673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 666/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:29.529919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:29.530428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:29.530879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:29.539948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 669/1335] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:29.543354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59ef0-4277-4113-8a4b-f949f577e92c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:29.543914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59ef0-4277-4113-8a4b-f949f577e92c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:29.544417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59ef0-4277-4113-8a4b-f949f577e92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:29.670337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-24e59ef0-4277-4113-8a4b-f949f577e92c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:29.672472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-24e59ef0-4277-4113-8a4b-f949f577e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:29.780478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:29.804591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 667/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:29.845998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:29.847578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:29.968891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6830b-defe-41a6-8605-07726fc58d8a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:30.001045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:30.056134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:30.056724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:30.057002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:30.057266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:30.059122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:30.191334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:30.192840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41dc48-e625-4ea3-9abd-74f93258b81b service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:30.214695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 670/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:33.987400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:33.988077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:33.988077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:33.989347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 668/1338] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:45:33.999566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac9dd-70c2-4180-ae70-fda0b14675cc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:34.000177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac9dd-70c2-4180-ae70-fda0b14675cc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:34.000177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac9dd-70c2-4180-ae70-fda0b14675cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:34.078060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-409ac9dd-70c2-4180-ae70-fda0b14675cc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:34.079292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-409ac9dd-70c2-4180-ae70-fda0b14675cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:34.090427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:34.223961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 671/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:34.260860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:34.263297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:34.372785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b227db-e696-4f0b-9573-106bbd8bb911 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:34.376641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:34.377301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:34.377583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:34.377860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:34.388695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:34.390155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1347ba-c671-45f6-8dd9-feb723407eea service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:34.401199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 669/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:39.363429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5666a1-6c69-4094-9a7f-735e7ec0b9a3 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:39.364073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5666a1-6c69-4094-9a7f-735e7ec0b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:39.364667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5666a1-6c69-4094-9a7f-735e7ec0b9a3 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:39.368098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 672/1341] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:39.374152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a4e-38db-4152-bec6-63ae2075579e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:39.374798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a4e-38db-4152-bec6-63ae2075579e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:39.374798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a4e-38db-4152-bec6-63ae2075579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:39.411925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-defe5a4e-38db-4152-bec6-63ae2075579e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:39.413214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-defe5a4e-38db-4152-bec6-63ae2075579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:39.521937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 670/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:45:39.585210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5666a1-6c69-4094-9a7f-735e7ec0b9a3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:39.598606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5666a1-6c69-4094-9a7f-735e7ec0b9a3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:39.603783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:39.604569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:39.604996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:39.605367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:39.615826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:39.618272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70372a8-c95d-4cc8-bf57-502787285536 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:39.628690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 673/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:42.888464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:42.889060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:42.889060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:42.890585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 671/1344] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:42.895956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f186f5-a55e-4491-83d7-e8cffa5890f5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:42.896709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f186f5-a55e-4491-83d7-e8cffa5890f5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:42.896931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f186f5-a55e-4491-83d7-e8cffa5890f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:42.915551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-29f186f5-a55e-4491-83d7-e8cffa5890f5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:42.916796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-29f186f5-a55e-4491-83d7-e8cffa5890f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:42.924884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 674/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:45:42.965221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:42.966947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:42.981261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4ee27-863e-4fe3-bbc0-32072e7eaf7e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:42.985052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:42.985737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:42.986171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:42.986451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:42.998018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:42.999502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fafb9c-2bf0-4d10-ad4d-1149b78003a9 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:43.011857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 672/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:48.192827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525b84-6f2e-41e1-8feb-cc799213abc6 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:48.193364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525b84-6f2e-41e1-8feb-cc799213abc6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:48.193364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525b84-6f2e-41e1-8feb-cc799213abc6 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:48.194981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 675/1347] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:48.202648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87079c-cc53-40b2-a252-898a294b7b0b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:48.203138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87079c-cc53-40b2-a252-898a294b7b0b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:48.203404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87079c-cc53-40b2-a252-898a294b7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:48.227457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-db87079c-cc53-40b2-a252-898a294b7b0b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:48.228736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-db87079c-cc53-40b2-a252-898a294b7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:48.242518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 673/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:48.299060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34525b84-6f2e-41e1-8feb-cc799213abc6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:45:48.322499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34525b84-6f2e-41e1-8feb-cc799213abc6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:45:48.326350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:45:48.326944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:48.327222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:48.327495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:48.340663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:45:48.342526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980202be-25a3-46e9-b7e2-4ae9b3c5f7d4 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:45:48.354357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 676/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:45:54.051759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f8e1-508a-4f1d-9633-8110a0bad9d9 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:54.052310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f8e1-508a-4f1d-9633-8110a0bad9d9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:54.052395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f8e1-508a-4f1d-9633-8110a0bad9d9 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:54.055984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 674/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:54.060587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980c0bd-5921-4091-8f06-157fbe446182 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:54.061467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980c0bd-5921-4091-8f06-157fbe446182 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:54.061944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980c0bd-5921-4091-8f06-157fbe446182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:54.154034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9980c0bd-5921-4091-8f06-157fbe446182 None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:54.155267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9980c0bd-5921-4091-8f06-157fbe446182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:54.239190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:54.287211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 677/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:45:58.220649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:59.097271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb044b-04f8-477e-98ba-26fa12410d1a None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:59.097783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb044b-04f8-477e-98ba-26fa12410d1a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:59.098462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb044b-04f8-477e-98ba-26fa12410d1a None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:59.101743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 675/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:45:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:45:59.107592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f58d-15b5-45bb-b556-da548688f3dc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:45:59.108780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f58d-15b5-45bb-b556-da548688f3dc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:45:59.109281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f58d-15b5-45bb-b556-da548688f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:45:59.127972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3fc9f58d-15b5-45bb-b556-da548688f3dc None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:45:59.129212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3fc9f58d-15b5-45bb-b556-da548688f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:45:59.140132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 678/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:00.739218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380f8c-2cf3-40ee-8b15-421dc458253c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:00.739733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380f8c-2cf3-40ee-8b15-421dc458253c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:00.739849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380f8c-2cf3-40ee-8b15-421dc458253c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:00.741794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 676/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:00.747354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2fd-94b8-48ac-bb74-20ea9babbfca None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:00.747910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2fd-94b8-48ac-bb74-20ea9babbfca None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:00.747910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8f2fd-94b8-48ac-bb74-20ea9babbfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:00.766794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-27e8f2fd-94b8-48ac-bb74-20ea9babbfca None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:00.768108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-27e8f2fd-94b8-48ac-bb74-20ea9babbfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:00.776968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 679/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:46:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:46:04.523849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206da0-421e-489d-a0b3-f4987286ef4c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:04.524372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206da0-421e-489d-a0b3-f4987286ef4c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:04.524372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206da0-421e-489d-a0b3-f4987286ef4c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:04.525694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 677/1356] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:04.531171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a731-c73a-4be8-9aeb-c56080dcfb53 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:04.531598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a731-c73a-4be8-9aeb-c56080dcfb53 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:04.531713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a731-c73a-4be8-9aeb-c56080dcfb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:04.549635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7ce1a731-c73a-4be8-9aeb-c56080dcfb53 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:04.550860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7ce1a731-c73a-4be8-9aeb-c56080dcfb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:04.559371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 680/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:04.618613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104749-7ba2-4143-82d8-98ed6f9529eb None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:04.618988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104749-7ba2-4143-82d8-98ed6f9529eb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:04.619476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104749-7ba2-4143-82d8-98ed6f9529eb None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:04.621699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 678/1358] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jun 15 14:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:04.638828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f604b-ad96-4632-bae9-010bc3d03549 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:04.639688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f604b-ad96-4632-bae9-010bc3d03549 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:04.640193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f604b-ad96-4632-bae9-010bc3d03549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:04.696651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0c8f604b-ad96-4632-bae9-010bc3d03549 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:04.698117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0c8f604b-ad96-4632-bae9-010bc3d03549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:04.790526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 681/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jun 15 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:04.798600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1104749-7ba2-4143-82d8-98ed6f9529eb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:04.814665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1104749-7ba2-4143-82d8-98ed6f9529eb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:04.820650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:04.821351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:04.821638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:04.821916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:04.831148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:04.832873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f94a6-d24b-4b64-bd95-30e015ba1251 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:04.844051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 679/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:46:07.250358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024ce4-7c4a-46ee-b7c4-c67d1543b765 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:07.251360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024ce4-7c4a-46ee-b7c4-c67d1543b765 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:07.251934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024ce4-7c4a-46ee-b7c4-c67d1543b765 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:07.253501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 682/1361] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:07.259735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8391-6137-419b-b2ba-e7671d344890 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:07.260261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8391-6137-419b-b2ba-e7671d344890 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:07.260361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8391-6137-419b-b2ba-e7671d344890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:07.279783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-fbcd8391-6137-419b-b2ba-e7671d344890 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:07.281013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fbcd8391-6137-419b-b2ba-e7671d344890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:07.289292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 680/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:46:07.335527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024ce4-7c4a-46ee-b7c4-c67d1543b765 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:07.349923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024ce4-7c4a-46ee-b7c4-c67d1543b765 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:07.355476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:07.356150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:07.356446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:07.356726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:07.365773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:07.367398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131bf99-8dd1-4360-a6af-8ff658fa2e47 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:07.377816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 683/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:10.029855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a1e8-eda0-43b7-b362-e99a0f1600eb None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:10.062116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a1e8-eda0-43b7-b362-e99a0f1600eb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:10.062116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a1e8-eda0-43b7-b362-e99a0f1600eb None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:10.062116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 681/1364] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:10.062423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e69d2-2095-46b8-9e59-a9a55088560c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:10.062423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e69d2-2095-46b8-9e59-a9a55088560c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:10.062423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e69d2-2095-46b8-9e59-a9a55088560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:10.062423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4a4e69d2-2095-46b8-9e59-a9a55088560c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:10.062423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4a4e69d2-2095-46b8-9e59-a9a55088560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:10.065591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 684/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:10.114996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc8e-7cc7-4f40-8173-afdd54c10423 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:10.146305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc8e-7cc7-4f40-8173-afdd54c10423 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:10.146305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc8e-7cc7-4f40-8173-afdd54c10423 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:10.146305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 682/1366] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jun 15 14:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:10.146645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484fd4-13e0-46f3-a71b-18213b4f7837 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:10.146645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484fd4-13e0-46f3-a71b-18213b4f7837 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:10.146645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484fd4-13e0-46f3-a71b-18213b4f7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:10.151098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d6484fd4-13e0-46f3-a71b-18213b4f7837 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:10.152407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d6484fd4-13e0-46f3-a71b-18213b4f7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:10.173142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 685/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jun 15 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:10.186256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3cc8e-7cc7-4f40-8173-afdd54c10423 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:10.197254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3cc8e-7cc7-4f40-8173-afdd54c10423 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:10.202973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:10.203740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:10.204065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:10.204342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:10.213909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:10.215544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464923fc-bef4-4b71-819e-fc8cf11a7081 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:10.225511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 683/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:12.705195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85ead-a8ab-4b0b-8a23-b5b30e0f6dcb None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:12.706101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85ead-a8ab-4b0b-8a23-b5b30e0f6dcb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:12.706542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85ead-a8ab-4b0b-8a23-b5b30e0f6dcb None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:12.708183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 686/1369] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:12.714563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299be0-8bf4-4887-bd52-d4241f8db704 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:12.715059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299be0-8bf4-4887-bd52-d4241f8db704 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:12.715161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299be0-8bf4-4887-bd52-d4241f8db704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:12.742207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-43299be0-8bf4-4887-bd52-d4241f8db704 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:12.743438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-43299be0-8bf4-4887-bd52-d4241f8db704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:12.751840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 684/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:46:12.797227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85ead-a8ab-4b0b-8a23-b5b30e0f6dcb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:12.813408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85ead-a8ab-4b0b-8a23-b5b30e0f6dcb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:12.821133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:12.822199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:12.822668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:12.823111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:12.833043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:12.835550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8b502-9a9e-4b9b-871f-cafc100c3576 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:12.846155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 687/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:12.874225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821800-69d1-4592-8b36-e41b842a1e99 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:12.874517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821800-69d1-4592-8b36-e41b842a1e99 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:12.877296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821800-69d1-4592-8b36-e41b842a1e99 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:12.877296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 685/1372] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:12.881803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf322-93bf-4406-b1bc-8ac4dd5265aa None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:12.882089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf322-93bf-4406-b1bc-8ac4dd5265aa None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:12.882370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf322-93bf-4406-b1bc-8ac4dd5265aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:12.901010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ef5bf322-93bf-4406-b1bc-8ac4dd5265aa None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:12.902210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ef5bf322-93bf-4406-b1bc-8ac4dd5265aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:12.910186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 688/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:13.226288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464532f-7aec-429f-b86b-aa7fdbd1ff6b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:13.226288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464532f-7aec-429f-b86b-aa7fdbd1ff6b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:13.227147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464532f-7aec-429f-b86b-aa7fdbd1ff6b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:13.228911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 686/1374] 10.222.0.49 () {54 vars in 963 bytes} [Wed Jun 15 14:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:13.235295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac106-ab8a-4f31-b9b5-9f6d826a4fa5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:13.236754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac106-ab8a-4f31-b9b5-9f6d826a4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:13.237296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac106-ab8a-4f31-b9b5-9f6d826a4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:13.292815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-331ac106-ab8a-4f31-b9b5-9f6d826a4fa5 None None] MFA Rules not processed for user `146205bc397741d2b8c8d69f94523b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:13.294020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-331ac106-ab8a-4f31-b9b5-9f6d826a4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:13.298817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:13.361418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 689/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Jun 15 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:13.368810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464532f-7aec-429f-b86b-aa7fdbd1ff6b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:13.380039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464532f-7aec-429f-b86b-aa7fdbd1ff6b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:13.384662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:13.385307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:13.385586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:13.385857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:13.396370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:13.398608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac95a1-e0d0-44ee-af68-66a59db16967 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:13.409542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 687/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:15.238481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5214ee-2e41-41a0-91b5-2cf082f5e162 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:15.239042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5214ee-2e41-41a0-91b5-2cf082f5e162 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:15.239042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5214ee-2e41-41a0-91b5-2cf082f5e162 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:15.241115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 690/1377] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:15.247177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148034-6292-4175-ad8e-108b0ad213da None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:15.247715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148034-6292-4175-ad8e-108b0ad213da None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:15.247876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148034-6292-4175-ad8e-108b0ad213da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:15.267702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f5148034-6292-4175-ad8e-108b0ad213da None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:15.268963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f5148034-6292-4175-ad8e-108b0ad213da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:15.277389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 688/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:15.322866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5214ee-2e41-41a0-91b5-2cf082f5e162 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:15.345001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5214ee-2e41-41a0-91b5-2cf082f5e162 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:15.345219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:15.345877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:15.346161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:15.346436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:15.356421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:15.358100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97558-c13e-491e-b5db-d1bce04d1acf service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:15.370100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 691/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:17.762436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203f9a-8ad8-43ee-adee-fe597b274477 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:17.763016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203f9a-8ad8-43ee-adee-fe597b274477 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:17.763016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203f9a-8ad8-43ee-adee-fe597b274477 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:17.764415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 689/1380] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:17.770073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc6a3-dc24-477d-bb62-e2b5c325c288 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:17.770587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc6a3-dc24-477d-bb62-e2b5c325c288 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:17.770682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc6a3-dc24-477d-bb62-e2b5c325c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:17.790340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d23bc6a3-dc24-477d-bb62-e2b5c325c288 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:17.791562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d23bc6a3-dc24-477d-bb62-e2b5c325c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:17.799518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 692/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:17.846073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53203f9a-8ad8-43ee-adee-fe597b274477 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:17.861769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53203f9a-8ad8-43ee-adee-fe597b274477 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:17.869101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:17.869425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:17.869704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:17.869975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:17.878897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:17.880516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d779f-3315-4c24-b8d4-a44d288407fd service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:17.897512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 690/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:46:20.224304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55f2c1-eb21-4e50-8116-dd46adf24772 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:20.225119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55f2c1-eb21-4e50-8116-dd46adf24772 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:20.225305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55f2c1-eb21-4e50-8116-dd46adf24772 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:20.227058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 693/1383] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:20.233277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2478-afd2-43f0-9bd9-012cafaa74d8 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:20.233913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2478-afd2-43f0-9bd9-012cafaa74d8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:20.234056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2478-afd2-43f0-9bd9-012cafaa74d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:20.257528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2ade2478-afd2-43f0-9bd9-012cafaa74d8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:20.258927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2ade2478-afd2-43f0-9bd9-012cafaa74d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:20.267838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 691/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:20.311243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55f2c1-eb21-4e50-8116-dd46adf24772 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:20.326836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55f2c1-eb21-4e50-8116-dd46adf24772 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:20.333460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:20.334149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:20.334593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:20.335008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:20.344175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:20.346379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32127beb-9bdd-4469-9dbb-e14169f7f39d service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:20.359999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 694/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:23.616737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf57c-7f00-4e64-9c62-396615b2c6ae None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:23.617288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf57c-7f00-4e64-9c62-396615b2c6ae None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:23.617460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf57c-7f00-4e64-9c62-396615b2c6ae None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:23.619341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 692/1386] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:23.625134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743674-b3b8-476b-823b-302b47cfc40a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:23.625613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743674-b3b8-476b-823b-302b47cfc40a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:23.625719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743674-b3b8-476b-823b-302b47cfc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:23.644080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1a743674-b3b8-476b-823b-302b47cfc40a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:23.645284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1a743674-b3b8-476b-823b-302b47cfc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:23.653941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 695/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:23.699327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edf57c-7f00-4e64-9c62-396615b2c6ae None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:23.714734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edf57c-7f00-4e64-9c62-396615b2c6ae None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:23.720379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:23.721080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:23.721366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:23.721642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:23.731162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:23.733066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027334b-6c79-43fd-b974-d6350de9b97a service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:23.743441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 693/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:26.152140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e954-6b04-48fb-ae6f-ff4e3874a848 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:26.152722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e954-6b04-48fb-ae6f-ff4e3874a848 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:26.152722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e954-6b04-48fb-ae6f-ff4e3874a848 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:26.154183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 696/1389] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:26.159623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696dad-2d78-41f7-b09f-3394a7457911 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:26.160186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696dad-2d78-41f7-b09f-3394a7457911 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:26.160186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696dad-2d78-41f7-b09f-3394a7457911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:26.179207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-44696dad-2d78-41f7-b09f-3394a7457911 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:26.180473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-44696dad-2d78-41f7-b09f-3394a7457911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:26.188733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 694/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:46:26.235553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e954-6b04-48fb-ae6f-ff4e3874a848 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:26.254692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e954-6b04-48fb-ae6f-ff4e3874a848 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:26.262562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:26.271884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:26.271884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:26.271884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:26.275078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:26.278176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d6d11-fd44-4bc5-9e02-f171e6a778c1 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:26.293363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 697/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:29.218397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94231-e74f-422b-b068-39b172c586ab None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:29.218935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94231-e74f-422b-b068-39b172c586ab None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:29.219106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94231-e74f-422b-b068-39b172c586ab None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:29.220707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 695/1392] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:29.226856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15a67-1894-4840-879e-c4c7f7a329d0 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:29.227392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15a67-1894-4840-879e-c4c7f7a329d0 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:29.227392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15a67-1894-4840-879e-c4c7f7a329d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:29.245888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9ed15a67-1894-4840-879e-c4c7f7a329d0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:29.247139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9ed15a67-1894-4840-879e-c4c7f7a329d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:29.255242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 698/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:29.300691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94231-e74f-422b-b068-39b172c586ab None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:29.309200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=46 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:29.315890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94231-e74f-422b-b068-39b172c586ab None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:29.321936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:29.322582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:29.322865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:29.323141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:29.332052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:29.334597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15963-4db8-44e5-8de8-a72fb85b60bc service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:29.344884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 696/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:31.275727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630865f-db7d-4d9e-b2a4-8fe7a4c12661 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.276320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630865f-db7d-4d9e-b2a4-8fe7a4c12661 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.276421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630865f-db7d-4d9e-b2a4-8fe7a4c12661 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.277870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 699/1395] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:31.283307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64270c8-3fb4-4648-b656-cf9b68a42707 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.283730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64270c8-3fb4-4648-b656-cf9b68a42707 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.284432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64270c8-3fb4-4648-b656-cf9b68a42707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.302094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c64270c8-3fb4-4648-b656-cf9b68a42707 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:31.303494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c64270c8-3fb4-4648-b656-cf9b68a42707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:31.311768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 697/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:31.369553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0761-9724-4ff2-9a0a-280fcd1652de None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.369846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0761-9724-4ff2-9a0a-280fcd1652de None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.370128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0761-9724-4ff2-9a0a-280fcd1652de None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.371675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 700/1397] 10.222.0.49 () {54 vars in 962 bytes} [Wed Jun 15 14:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:31.377242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125942e-0ffe-4cac-90cb-74930aff1cca None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.377677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125942e-0ffe-4cac-90cb-74930aff1cca None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.378033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125942e-0ffe-4cac-90cb-74930aff1cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.431574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1125942e-0ffe-4cac-90cb-74930aff1cca None None] MFA Rules not processed for user `150269945dcc49b0ac4f074e88312177`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:31.432879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1125942e-0ffe-4cac-90cb-74930aff1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:31.501356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 698/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Jun 15 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:31.510326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0761-9724-4ff2-9a0a-280fcd1652de None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:31.521858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0761-9724-4ff2-9a0a-280fcd1652de None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:31.525705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:31.528392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.528392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.528392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.537356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:31.539232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d16f0-a1d2-4093-b64b-299e257c2f7e service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:31.549858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 701/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:31.632672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddad-d7ee-4425-b0ca-ea4abf7c30ec None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.633003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddad-d7ee-4425-b0ca-ea4abf7c30ec None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.633290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddad-d7ee-4425-b0ca-ea4abf7c30ec None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.634859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 699/1400] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:31.640850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f1b9-087d-45cd-88f2-94520fe8de81 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.641143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f1b9-087d-45cd-88f2-94520fe8de81 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.641422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f1b9-087d-45cd-88f2-94520fe8de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.661032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-30a0f1b9-087d-45cd-88f2-94520fe8de81 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:31.663346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-30a0f1b9-087d-45cd-88f2-94520fe8de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:31.671704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 702/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:31.722761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fddad-d7ee-4425-b0ca-ea4abf7c30ec None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:31.745514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fddad-d7ee-4425-b0ca-ea4abf7c30ec None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:31.751012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:31.751663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:31.751981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:31.752265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:31.761388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:31.762982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2c2e6-c051-4076-9bd2-b5377d389a1e service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:31.773998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 700/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:32.393262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01589-c51a-4f7b-a6e0-b657786294a3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:32.393871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01589-c51a-4f7b-a6e0-b657786294a3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:32.393871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01589-c51a-4f7b-a6e0-b657786294a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:32.445298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d2a01589-c51a-4f7b-a6e0-b657786294a3 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:32.446503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d2a01589-c51a-4f7b-a6e0-b657786294a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:32.510598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 703/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:32.557329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d948f-258e-4002-971a-f47c69f6dd1d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:32.557782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d948f-258e-4002-971a-f47c69f6dd1d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:32.557926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d948f-258e-4002-971a-f47c69f6dd1d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:32.559368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 942 bytes} [Wed Jun 15 14:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:32.565772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139073-b47b-4096-9947-c04b40ea3cc4 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:32.566066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139073-b47b-4096-9947-c04b40ea3cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:32.566346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139073-b47b-4096-9947-c04b40ea3cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:32.572992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:32.620737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e6139073-b47b-4096-9947-c04b40ea3cc4 None None] MFA Rules not processed for user `3b4d5d5ee8b54056b747948ee0aa4b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:32.622045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e6139073-b47b-4096-9947-c04b40ea3cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:32.696514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Wed Jun 15 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:32.706241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d948f-258e-4002-971a-f47c69f6dd1d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:32.720166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d948f-258e-4002-971a-f47c69f6dd1d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:32.725950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:32.726601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:32.726885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:32.727167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:32.737341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:32.739128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0169d-2f2b-4f92-ba20-c326a5265c7e service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:32.748859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:46:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:46:34.174029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddf55-ed60-4813-bd94-092402eb09fa None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:34.174566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddf55-ed60-4813-bd94-092402eb09fa None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:34.175039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddf55-ed60-4813-bd94-092402eb09fa None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:34.176051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:34.181979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0dce-e58f-4246-90c0-35354f9277c4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:34.182479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0dce-e58f-4246-90c0-35354f9277c4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:34.184003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0dce-e58f-4246-90c0-35354f9277c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:34.207360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2f4a0dce-e58f-4246-90c0-35354f9277c4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:34.208778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2f4a0dce-e58f-4246-90c0-35354f9277c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:34.227845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:34.266808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cddf55-ed60-4813-bd94-092402eb09fa None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:34.284666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cddf55-ed60-4813-bd94-092402eb09fa None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:34.291034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:34.291678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:34.291992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:34.292272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:34.304571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:34.306470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074e127-2cfc-4837-80f5-48e02019b813 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:46:34.320790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:46:44.201205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=61 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:44.315218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=49 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:57.089366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b744e-cb44-4e19-a825-ee0cce942a9b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:57.089366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b744e-cb44-4e19-a825-ee0cce942a9b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:57.089366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b744e-cb44-4e19-a825-ee0cce942a9b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:57.090453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed Jun 15 14:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:57.096059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38ac-2306-4f17-ab46-4def81a02f3d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:57.096543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38ac-2306-4f17-ab46-4def81a02f3d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:57.096651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38ac-2306-4f17-ab46-4def81a02f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:57.116410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b21c38ac-2306-4f17-ab46-4def81a02f3d None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:57.117626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b21c38ac-2306-4f17-ab46-4def81a02f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:57.127018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jun 15 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:57.141653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9f61-0cb0-4586-9dc4-546e450fce53 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:57.141940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9f61-0cb0-4586-9dc4-546e450fce53 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:57.142213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9f61-0cb0-4586-9dc4-546e450fce53 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:57.143585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed Jun 15 14:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:57.149613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea4bb-3dbe-4e0d-aca7-a1d0410469c5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:57.149955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea4bb-3dbe-4e0d-aca7-a1d0410469c5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:57.150267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea4bb-3dbe-4e0d-aca7-a1d0410469c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:57.168815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-379ea4bb-3dbe-4e0d-aca7-a1d0410469c5 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:57.169850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-379ea4bb-3dbe-4e0d-aca7-a1d0410469c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:57.179573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jun 15 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:59.877449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa887c-1482-45e1-81f6-ea347340a5c6 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:59.878023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa887c-1482-45e1-81f6-ea347340a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:59.878023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa887c-1482-45e1-81f6-ea347340a5c6 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:59.879532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:46:59.886515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b1dc-c366-415f-9d0c-d67ca7448b15 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:59.886974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b1dc-c366-415f-9d0c-d67ca7448b15 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:59.887082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b1dc-c366-415f-9d0c-d67ca7448b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:59.906081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-97f0b1dc-c366-415f-9d0c-d67ca7448b15 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:46:59.907345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-97f0b1dc-c366-415f-9d0c-d67ca7448b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:46:59.915414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:46:59.960159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa887c-1482-45e1-81f6-ea347340a5c6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:46:59.975133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa887c-1482-45e1-81f6-ea347340a5c6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:46:59.980508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:46:59.981194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:46:59.981427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:46:59.981701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:46:59.990550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:46:59.992165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d84a0-7a78-48b2-acf8-a105ef156f42 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:00.001850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:00.975782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a243bb-178c-4a4c-8e77-b484314a2ed7 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:00.976366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a243bb-178c-4a4c-8e77-b484314a2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:00.976366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a243bb-178c-4a4c-8e77-b484314a2ed7 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:00.977741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:47:00.982663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239156-f60b-4c8c-8f4c-1522fab6c1aa None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:00.983052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239156-f60b-4c8c-8f4c-1522fab6c1aa None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:00.983153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239156-f60b-4c8c-8f4c-1522fab6c1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:01.003083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5d239156-f60b-4c8c-8f4c-1522fab6c1aa None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:01.004379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5d239156-f60b-4c8c-8f4c-1522fab6c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:01.013504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:01.179784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a243bb-178c-4a4c-8e77-b484314a2ed7 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:01.194513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a243bb-178c-4a4c-8e77-b484314a2ed7 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:01.200505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:01.201156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:01.201431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:01.201697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:01.217627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:01.217627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf61159-58f6-4f33-8e94-3b1ecfc60760 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:01.226806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:02.159776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac7db-b8bd-4c5c-a1d6-993d716889ed None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:02.160346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac7db-b8bd-4c5c-a1d6-993d716889ed None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:02.160346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac7db-b8bd-4c5c-a1d6-993d716889ed None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:02.162483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:02.167499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516259d-7fe7-4726-ae8c-2884d5c1864f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:02.167933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516259d-7fe7-4726-ae8c-2884d5c1864f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:02.168153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516259d-7fe7-4726-ae8c-2884d5c1864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:02.186789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f516259d-7fe7-4726-ae8c-2884d5c1864f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:02.188020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f516259d-7fe7-4726-ae8c-2884d5c1864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:02.196248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:02.350059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac7db-b8bd-4c5c-a1d6-993d716889ed None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:02.364417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac7db-b8bd-4c5c-a1d6-993d716889ed None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:02.370977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:02.371663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:02.371981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:02.372292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:02.381398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:02.382987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7582-4072-47f3-92af-4936344d24d8 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:02.392537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:47:03.327023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b80f2-9f19-4f43-ad79-2b88ed365a9a None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:03.327610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b80f2-9f19-4f43-ad79-2b88ed365a9a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:03.327610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b80f2-9f19-4f43-ad79-2b88ed365a9a None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:03.329035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:03.334369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3432-ee1b-434a-8f63-ea9668230b6a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:03.334798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3432-ee1b-434a-8f63-ea9668230b6a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:03.335052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3432-ee1b-434a-8f63-ea9668230b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:03.357859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d48b3432-ee1b-434a-8f63-ea9668230b6a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:03.359051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d48b3432-ee1b-434a-8f63-ea9668230b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:03.367699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:47:03.521517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b80f2-9f19-4f43-ad79-2b88ed365a9a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:03.536759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b80f2-9f19-4f43-ad79-2b88ed365a9a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:03.542371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:03.543031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:03.543339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:03.543607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:03.552917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:03.554499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb541d6-afa6-4815-8a9f-e499a339d1dd service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:03.564141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:04.484105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5c7c-0f22-4566-ae00-d2e6c01f1067 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:04.484714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5c7c-0f22-4566-ae00-d2e6c01f1067 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:04.484714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5c7c-0f22-4566-ae00-d2e6c01f1067 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:04.486067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:04.491716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3de0-e790-426a-a726-2988bff819c4 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:04.492224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3de0-e790-426a-a726-2988bff819c4 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:04.492354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3de0-e790-426a-a726-2988bff819c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:04.511604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-638d3de0-e790-426a-a726-2988bff819c4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:04.512851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-638d3de0-e790-426a-a726-2988bff819c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:04.521713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:04.674034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a5c7c-0f22-4566-ae00-d2e6c01f1067 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:04.688771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a5c7c-0f22-4566-ae00-d2e6c01f1067 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:04.694455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:04.695078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:04.695360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:04.695676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:04.703949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:04.705672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d715b-eae6-46f3-b0e1-99d8654e173b service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:04.716194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:05.646876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6505e5-d736-4927-91f1-21798ee3e304 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:05.647452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6505e5-d736-4927-91f1-21798ee3e304 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:05.647452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6505e5-d736-4927-91f1-21798ee3e304 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:05.648856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:05.653903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd818e0-253b-4ca2-9c59-8157b86f65a1 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:05.654345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd818e0-253b-4ca2-9c59-8157b86f65a1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:05.654475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd818e0-253b-4ca2-9c59-8157b86f65a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:05.673160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0fd818e0-253b-4ca2-9c59-8157b86f65a1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:05.674373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0fd818e0-253b-4ca2-9c59-8157b86f65a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:05.682876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:05.840931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6505e5-d736-4927-91f1-21798ee3e304 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:05.855825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6505e5-d736-4927-91f1-21798ee3e304 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:05.861150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:05.861794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:05.862071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:05.862343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:05.871527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:05.873170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594c5ec-6b7a-4062-8dfc-beeb1f25246d service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:05.882809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:06.857688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f03f5-40f2-45c2-aa7c-f8bde9090704 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:06.858269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f03f5-40f2-45c2-aa7c-f8bde9090704 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:06.858269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f03f5-40f2-45c2-aa7c-f8bde9090704 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:06.859649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:06.865207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066541-f089-4fd3-be4b-3f12b3a9dff4 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:06.865629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066541-f089-4fd3-be4b-3f12b3a9dff4 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:06.865746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066541-f089-4fd3-be4b-3f12b3a9dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:06.884402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-77066541-f089-4fd3-be4b-3f12b3a9dff4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:06.885588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-77066541-f089-4fd3-be4b-3f12b3a9dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:06.893307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:07.044586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f03f5-40f2-45c2-aa7c-f8bde9090704 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:07.059411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f03f5-40f2-45c2-aa7c-f8bde9090704 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:07.064829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:07.065467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:07.065755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:07.066033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:07.075637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:07.077274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbab4d0-eaba-4c5c-a533-bd61a7586dc6 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:07.087692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:08.010831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3957-78c5-4795-8926-340423cb293c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:08.011374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3957-78c5-4795-8926-340423cb293c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:08.011374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3957-78c5-4795-8926-340423cb293c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:08.012716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:08.017779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a87ba-2d9f-4016-bce0-ab8bd5fe481a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:08.018188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a87ba-2d9f-4016-bce0-ab8bd5fe481a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:08.018329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a87ba-2d9f-4016-bce0-ab8bd5fe481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:08.037730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-fe2a87ba-2d9f-4016-bce0-ab8bd5fe481a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:08.038934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fe2a87ba-2d9f-4016-bce0-ab8bd5fe481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:08.046850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:08.201877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3957-78c5-4795-8926-340423cb293c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:08.217173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3957-78c5-4795-8926-340423cb293c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:08.222570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:08.224058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:08.224208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:08.224439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:08.233001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:08.234597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05fba-95ce-476a-a5bf-3a79ace45964 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:08.244950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:09.170367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014926-3ee0-4a87-b13e-231e9b2dff43 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:09.170959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014926-3ee0-4a87-b13e-231e9b2dff43 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:09.170959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014926-3ee0-4a87-b13e-231e9b2dff43 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:09.172466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:09.177882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7352-b570-4981-bf78-862049155830 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:09.178340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7352-b570-4981-bf78-862049155830 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:09.178455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7352-b570-4981-bf78-862049155830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:09.197436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-dd7d7352-b570-4981-bf78-862049155830 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:09.198649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dd7d7352-b570-4981-bf78-862049155830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:09.206848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:09.360490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014926-3ee0-4a87-b13e-231e9b2dff43 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:09.374888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014926-3ee0-4a87-b13e-231e9b2dff43 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:09.381170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:09.381814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:09.382098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:09.382374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:09.391451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:09.393092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe580561-f89e-462f-a942-0c99191f516b service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:09.403957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:11.462423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2a20-5f20-4614-b1c4-92633bb79adf None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:11.462952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2a20-5f20-4614-b1c4-92633bb79adf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:11.462952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2a20-5f20-4614-b1c4-92633bb79adf None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:11.464320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:11.469605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbded7-fb68-4034-8f60-2b465a7fcd28 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:11.470092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbded7-fb68-4034-8f60-2b465a7fcd28 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:11.470195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbded7-fb68-4034-8f60-2b465a7fcd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:11.488117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-fbfbded7-fb68-4034-8f60-2b465a7fcd28 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:11.489877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fbfbded7-fb68-4034-8f60-2b465a7fcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:11.497926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:11.538141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb2a20-5f20-4614-b1c4-92633bb79adf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:11.549292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb2a20-5f20-4614-b1c4-92633bb79adf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:11.553877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:11.554514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:11.554793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:11.555065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:11.564598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:11.566132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacdc9-4b6b-4438-bba6-68a758aa52f0 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:11.576968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:13.911033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d86b-1672-4bc9-afa7-1b5a05dbfeed None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:13.911638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d86b-1672-4bc9-afa7-1b5a05dbfeed None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:13.911638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d86b-1672-4bc9-afa7-1b5a05dbfeed None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:13.913022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:13.918902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63d81-a4eb-4307-b1a7-9faf54a73f76 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:13.919325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63d81-a4eb-4307-b1a7-9faf54a73f76 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:13.919464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63d81-a4eb-4307-b1a7-9faf54a73f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:13.937451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ffa63d81-a4eb-4307-b1a7-9faf54a73f76 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:13.938664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ffa63d81-a4eb-4307-b1a7-9faf54a73f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:13.947326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:13.985898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8d86b-1672-4bc9-afa7-1b5a05dbfeed None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:13.997317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8d86b-1672-4bc9-afa7-1b5a05dbfeed None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:14.000790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:14.001418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:14.001696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:14.001966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:14.011586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:14.013025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940718-da4e-4cc9-bc14-37848b9cd47b service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:14.023032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:16.624127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb545-1e6e-4212-a053-70f699012c1d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:16.624694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb545-1e6e-4212-a053-70f699012c1d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:16.624694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb545-1e6e-4212-a053-70f699012c1d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:16.626131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:16.632220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c37e2-d19e-4dd3-9474-713eefb19da2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:16.632639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c37e2-d19e-4dd3-9474-713eefb19da2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:16.632801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c37e2-d19e-4dd3-9474-713eefb19da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:16.650716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-940c37e2-d19e-4dd3-9474-713eefb19da2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:16.651972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-940c37e2-d19e-4dd3-9474-713eefb19da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:16.660647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:16.700481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb545-1e6e-4212-a053-70f699012c1d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:16.711165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb545-1e6e-4212-a053-70f699012c1d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:16.714744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:16.715386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:16.715706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:16.716015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:16.725444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:16.726897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689c58-c9b7-4dd9-8560-845573c29eca service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:16.737108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:19.045249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750ae1-4d7f-4406-aa67-ce96ab2eb38d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:19.045812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750ae1-4d7f-4406-aa67-ce96ab2eb38d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:19.045812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750ae1-4d7f-4406-aa67-ce96ab2eb38d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:19.047118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:19.052401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff94c7-10c3-4071-b53b-76196ebc8ebc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:19.052814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff94c7-10c3-4071-b53b-76196ebc8ebc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:19.052951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff94c7-10c3-4071-b53b-76196ebc8ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:19.072568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1eff94c7-10c3-4071-b53b-76196ebc8ebc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:19.073779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1eff94c7-10c3-4071-b53b-76196ebc8ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:19.081602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:19.119638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2750ae1-4d7f-4406-aa67-ce96ab2eb38d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:19.133511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2750ae1-4d7f-4406-aa67-ce96ab2eb38d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:19.137136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:19.137774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:19.138056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:19.138333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:19.148622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:19.150055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c0ae7-a685-40b0-b4f8-f01262b2a68d service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:19.159907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:21.377122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8229-3d15-4933-a4fe-32726c0164da None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:21.377705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8229-3d15-4933-a4fe-32726c0164da None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:21.377705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8229-3d15-4933-a4fe-32726c0164da None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:21.379054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:21.384853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4936-a0dc-4fae-9f5e-cc6287824953 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:21.385293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4936-a0dc-4fae-9f5e-cc6287824953 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:21.385449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4936-a0dc-4fae-9f5e-cc6287824953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:21.403886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-813c4936-a0dc-4fae-9f5e-cc6287824953 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:21.405104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-813c4936-a0dc-4fae-9f5e-cc6287824953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:21.413229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:21.451376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8229-3d15-4933-a4fe-32726c0164da None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:21.462250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8229-3d15-4933-a4fe-32726c0164da None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:21.465691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:21.466354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:21.466644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:21.466919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:21.476925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:21.478299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe501-4fcd-427e-9ef1-3f8a4fc9c397 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:21.487880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:23.822095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40236a-1448-4c6f-97f3-d8ec5b72446b None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:23.822676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40236a-1448-4c6f-97f3-d8ec5b72446b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:23.822676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40236a-1448-4c6f-97f3-d8ec5b72446b None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:23.824109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:23.829454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1fa8-6772-4929-b2de-1cdd3fe5b481 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:23.829859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1fa8-6772-4929-b2de-1cdd3fe5b481 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:23.830042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1fa8-6772-4929-b2de-1cdd3fe5b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:23.847727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-cb7d1fa8-6772-4929-b2de-1cdd3fe5b481 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:23.849673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cb7d1fa8-6772-4929-b2de-1cdd3fe5b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:23.857452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:23.896405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40236a-1448-4c6f-97f3-d8ec5b72446b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:23.907403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40236a-1448-4c6f-97f3-d8ec5b72446b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:23.911795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:23.912465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:23.912749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:23.913024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:23.922515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:23.923994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3e508-832c-450f-997f-fdeb849b6fcc service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:23.934439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:47:26.209850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249a70-6c4f-4207-9d16-bd8f345e5a37 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:26.210602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249a70-6c4f-4207-9d16-bd8f345e5a37 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:26.210602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249a70-6c4f-4207-9d16-bd8f345e5a37 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:26.211788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:26.218392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab9ad-4a38-4baf-993f-e72e584743fe None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:26.218392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab9ad-4a38-4baf-993f-e72e584743fe None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:26.218392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab9ad-4a38-4baf-993f-e72e584743fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:26.224750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=70 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:26.236853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f8eab9ad-4a38-4baf-993f-e72e584743fe None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:26.238112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f8eab9ad-4a38-4baf-993f-e72e584743fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:26.246469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:47:26.284179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a249a70-6c4f-4207-9d16-bd8f345e5a37 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:26.290260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=73 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:26.296040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a249a70-6c4f-4207-9d16-bd8f345e5a37 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:26.299536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:26.300212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:26.300493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:26.300765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:26.309979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:26.311419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae032a0-9ff8-4571-ac25-abd5441016cc service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:26.321723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:28.526710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f793eb-e807-41c2-ad92-fb85c3adf986 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:28.527289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f793eb-e807-41c2-ad92-fb85c3adf986 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:28.527289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f793eb-e807-41c2-ad92-fb85c3adf986 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:28.528946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:47:28.535103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5240-d69f-4aee-89b3-3916417d8c48 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:28.535758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5240-d69f-4aee-89b3-3916417d8c48 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:28.535758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5240-d69f-4aee-89b3-3916417d8c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:28.555181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a38a5240-d69f-4aee-89b3-3916417d8c48 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:28.556492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a38a5240-d69f-4aee-89b3-3916417d8c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:28.564707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:28.604254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f793eb-e807-41c2-ad92-fb85c3adf986 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:28.616400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f793eb-e807-41c2-ad92-fb85c3adf986 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:28.620068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:28.620734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:28.621017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:28.621300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:28.632288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:28.633787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dc552-482d-46d5-8f90-826ff8d2b0b7 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:28.644529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:47:30.956028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a3ff-309f-4791-81ff-dddc950ec3ba None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:30.956591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a3ff-309f-4791-81ff-dddc950ec3ba None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:30.956681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a3ff-309f-4791-81ff-dddc950ec3ba None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:30.959251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:30.965118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de834ce-21fd-43ed-88a9-d566f5998a3c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:30.965669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de834ce-21fd-43ed-88a9-d566f5998a3c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:30.965669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de834ce-21fd-43ed-88a9-d566f5998a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:30.985292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4de834ce-21fd-43ed-88a9-d566f5998a3c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:30.986409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4de834ce-21fd-43ed-88a9-d566f5998a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:30.994430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:47:31.032706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a3ff-309f-4791-81ff-dddc950ec3ba None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:31.044569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a3ff-309f-4791-81ff-dddc950ec3ba None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:31.048114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:31.048761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:31.049042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:31.049324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:31.058984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:31.060483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd41f3-0f43-40cd-af94-c2b280a3c948 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:31.071123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:33.273329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6000-4db9-4abf-80e6-e9268f96141e None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:33.273909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6000-4db9-4abf-80e6-e9268f96141e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:33.273909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6000-4db9-4abf-80e6-e9268f96141e None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:33.275291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:33.280861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4828-65c1-460d-8326-b43529df464d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:33.281305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4828-65c1-460d-8326-b43529df464d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:33.281417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4828-65c1-460d-8326-b43529df464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:33.301595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8bbe4828-65c1-460d-8326-b43529df464d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:33.303074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8bbe4828-65c1-460d-8326-b43529df464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:33.311131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:33.348598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6000-4db9-4abf-80e6-e9268f96141e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:33.359653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6000-4db9-4abf-80e6-e9268f96141e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:33.363293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:33.364704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:33.364993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:33.365270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:33.374974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:33.376482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973a45f-495e-4bba-9c05-3988f328bad0 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:33.386707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:43.295570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=17 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:43.382265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=17 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:53.843736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166e9f-af54-452d-a676-f4522cd71a26 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:53.844369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166e9f-af54-452d-a676-f4522cd71a26 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:53.844369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166e9f-af54-452d-a676-f4522cd71a26 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:53.845716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:53.851191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478aa74-7049-4015-af49-4187fc1fa263 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:53.851683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478aa74-7049-4015-af49-4187fc1fa263 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:53.851799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478aa74-7049-4015-af49-4187fc1fa263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:53.870282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f478aa74-7049-4015-af49-4187fc1fa263 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:53.871491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f478aa74-7049-4015-af49-4187fc1fa263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:53.879356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:53.927747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9104e-e1c7-45d1-a66b-a892b426991d None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:53.928052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9104e-e1c7-45d1-a66b-a892b426991d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:53.928335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9104e-e1c7-45d1-a66b-a892b426991d None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:53.929742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 962 bytes} [Wed Jun 15 14:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:53.934832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224326-ab0b-433e-843b-c607e9fe7d1c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:53.935123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224326-ab0b-433e-843b-c607e9fe7d1c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:53.935404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224326-ab0b-433e-843b-c607e9fe7d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:53.954691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e9224326-ab0b-433e-843b-c607e9fe7d1c None None] MFA Rules not processed for user `150269945dcc49b0ac4f074e88312177`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:53.955899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e9224326-ab0b-433e-843b-c607e9fe7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:53.962795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Jun 15 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:53.970147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9104e-e1c7-45d1-a66b-a892b426991d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:53.981177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9104e-e1c7-45d1-a66b-a892b426991d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:53.984817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:53.985421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:53.985696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:53.985997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:53.995655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:53.997141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a40068-4afc-48a2-8bce-bd94cdbd016b service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:54.007348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:47:56.272944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ce8-7d8b-4dc7-bec7-3427741bbf19 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:56.273469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ce8-7d8b-4dc7-bec7-3427741bbf19 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:56.277217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ce8-7d8b-4dc7-bec7-3427741bbf19 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:56.277217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:56.280371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5880c-079e-4591-9919-52d413bbd0b2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:56.280779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5880c-079e-4591-9919-52d413bbd0b2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:56.280931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5880c-079e-4591-9919-52d413bbd0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:56.299544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1da5880c-079e-4591-9919-52d413bbd0b2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:56.300829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1da5880c-079e-4591-9919-52d413bbd0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:56.309191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:47:56.334389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3ce8-7d8b-4dc7-bec7-3427741bbf19 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:56.347199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3ce8-7d8b-4dc7-bec7-3427741bbf19 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:56.351717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:56.352402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:56.352685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:56.352960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:56.353692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:56.355444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:47:56.355444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:47:56.355444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:47:56.356621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6ab99-31b0-4687-9559-1af452508bc2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:56.377068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jun 15 14:47:56 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:47:58.592484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155369b-4d92-47e5-9db2-6ec47579be14 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:58.593057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155369b-4d92-47e5-9db2-6ec47579be14 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:58.593057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155369b-4d92-47e5-9db2-6ec47579be14 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:58.594452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:47:58.600846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd297d-537e-473a-8bab-eddb776b7e9f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:58.601344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd297d-537e-473a-8bab-eddb776b7e9f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:58.601464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd297d-537e-473a-8bab-eddb776b7e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:58.619521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-64dd297d-537e-473a-8bab-eddb776b7e9f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:47:58.620791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-64dd297d-537e-473a-8bab-eddb776b7e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:47:58.629053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:47:58.677032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155369b-4d92-47e5-9db2-6ec47579be14 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:47:58.692108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155369b-4d92-47e5-9db2-6ec47579be14 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:47:58.698070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:47:58.709660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:47:58.709660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:47:58.709660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:47:58.709660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:47:58.710856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b883deb-eed4-4f02-b335-ab51ee702473 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:47:58.721438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:48:01.070874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4ec0-1ed2-4778-9bfd-c19a1d5c73b2 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:01.071407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4ec0-1ed2-4778-9bfd-c19a1d5c73b2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:01.071407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4ec0-1ed2-4778-9bfd-c19a1d5c73b2 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:01.072813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:48:01.078395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8055f6-91ae-4539-906c-8960aa40dbbc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:01.078839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8055f6-91ae-4539-906c-8960aa40dbbc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:01.078954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8055f6-91ae-4539-906c-8960aa40dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:01.098312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3e8055f6-91ae-4539-906c-8960aa40dbbc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:48:01.099521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3e8055f6-91ae-4539-906c-8960aa40dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:48:01.107446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:48:01.143996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4ec0-1ed2-4778-9bfd-c19a1d5c73b2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:48:01.155792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4ec0-1ed2-4778-9bfd-c19a1d5c73b2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:48:01.159438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:48:01.160077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:01.160427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:01.160713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:01.170121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:48:01.171555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaabfa-415b-4571-9c16-7c7b4dedcfd3 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:48:01.181528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:48:03.403321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece3a5-433b-4da8-9e67-288ce765ee64 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:03.403925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece3a5-433b-4da8-9e67-288ce765ee64 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:03.403925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece3a5-433b-4da8-9e67-288ce765ee64 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:03.405317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:48:03.410487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df891-bec0-4cae-bc5f-881409ac5b28 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:03.410944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df891-bec0-4cae-bc5f-881409ac5b28 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:03.411584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df891-bec0-4cae-bc5f-881409ac5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:03.429884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5c2df891-bec0-4cae-bc5f-881409ac5b28 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:48:03.431127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5c2df891-bec0-4cae-bc5f-881409ac5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:48:03.438923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:48:03.476966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ece3a5-433b-4da8-9e67-288ce765ee64 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:48:03.487448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ece3a5-433b-4da8-9e67-288ce765ee64 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:48:03.491608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:48:03.492212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:03.492489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:03.492760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:03.502238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:48:03.503673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c1a68-eba0-43ec-99f0-12709b0dda54 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:48:03.513222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:48:05.810617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf46-b5fd-4299-b204-b5a981db570a None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:05.811158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf46-b5fd-4299-b204-b5a981db570a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:05.811158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf46-b5fd-4299-b204-b5a981db570a None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:05.812597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:48:05.817704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bb524-6982-47f5-a9ab-62d4fb90d8ff None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:05.818408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bb524-6982-47f5-a9ab-62d4fb90d8ff None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:05.818689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bb524-6982-47f5-a9ab-62d4fb90d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:05.836190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-2d1bb524-6982-47f5-a9ab-62d4fb90d8ff None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:48:05.837377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2d1bb524-6982-47f5-a9ab-62d4fb90d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:48:05.845431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:48:05.887343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76bf46-b5fd-4299-b204-b5a981db570a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:48:05.898641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76bf46-b5fd-4299-b204-b5a981db570a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:48:05.902159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:48:05.902799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:05.903085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:05.903361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:05.913653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:48:05.915098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abce297-5409-4705-adcf-7c62a536cc4e service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:48:05.924782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:48:08.552810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4afcf-82e2-497f-b380-0f22fc5db9b7 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:08.553360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4afcf-82e2-497f-b380-0f22fc5db9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:08.553360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4afcf-82e2-497f-b380-0f22fc5db9b7 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:08.554733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jun 15 14:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:48:08.559905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c510e-a375-4b2f-b38c-e1876e6ec6fc None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:08.560311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c510e-a375-4b2f-b38c-e1876e6ec6fc None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:08.560459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c510e-a375-4b2f-b38c-e1876e6ec6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:08.578075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-742c510e-a375-4b2f-b38c-e1876e6ec6fc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:48:08.579257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-742c510e-a375-4b2f-b38c-e1876e6ec6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:48:08.587065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jun 15 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:48:08.625623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4afcf-82e2-497f-b380-0f22fc5db9b7 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:48:08.636417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4afcf-82e2-497f-b380-0f22fc5db9b7 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:48:08.640266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:48:08.640899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:48:08.641174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:48:08.641443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:48:08.650774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:48:08.652246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fc0e-2e52-472c-a07b-1deff9b00c36 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:48:08.662269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:48:18.573122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=33 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:18.657438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=33 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:45.235603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.236238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.236238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.255420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:49:45.256880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:45.264740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:49:45.274073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.274589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.274589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.300007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:49:45.300007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:45.303378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:49:45.308001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.318077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38985-3039-4fd8-bdbc-86e923d2aac2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.322888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.323541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.323898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:49:45.329495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:45.338662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:49:45.346854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.356750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137927a-23c5-4b57-a1e7-98a14279171c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.361360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.362023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.362299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.362571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.363265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.365692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.365692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:49:45.365692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:49:45.366902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:45.462454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:49:45 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:49:45.466778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.477529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8238-d1e9-437e-a9e8-2d80df3e79b4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.535328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.535947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.536228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.536502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.537418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.538470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.538470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:49:45.538470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:49:45.539660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:45.627467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:49:45 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:49:45.632721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.643264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb750-8bc9-417f-a9c5-3fa342e865f3 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.648124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.648891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.649056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.649331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.650060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.651083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.651083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:49:45.651083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:49:45.652002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:45.665803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:49:45.670170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.680862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071e783-9a36-492d-937e-125c6a944f6e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.685582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.686233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.686519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.686793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.687517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.688555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.688555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:49:45.688555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:49:45.689429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a7e1b-c397-4d6b-b800-7f117215523f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:45.703916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:49:45.708235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:45.718693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fd9c-681f-4e17-b08d-c4e730f968fe admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:45.723250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:45.724178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:45.724459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:45.724797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] PATH_INFO: `/v3/projects/d217b236624a4653a24d7d60f8ae38ba/users/da7332e474664b678c78f4178fcf2180/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:45.740685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d217b236624a4653a24d7d60f8ae38ba, user_id=da7332e474664b678c78f4178fcf2180, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:45.741725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:45.741725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:49:45.741725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:49:45.743631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9c35-c569-479a-b276-5675eb04621b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:46.015473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:49:45 2022] PUT /identity/v3/projects/d217b236624a4653a24d7d60f8ae38ba/users/da7332e474664b678c78f4178fcf2180/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:49:46.026968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a7ab-1005-40dd-8889-18233ddea4ca None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.027252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a7ab-1005-40dd-8889-18233ddea4ca None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.027528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a7ab-1005-40dd-8889-18233ddea4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.056375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-35f6a7ab-1005-40dd-8889-18233ddea4ca None None] MFA Rules not processed for user `da7332e474664b678c78f4178fcf2180`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:49:46.057662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-35f6a7ab-1005-40dd-8889-18233ddea4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:46.122314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:49:46.135748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f9a6-fb98-42e6-a91f-af8c5219f431 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.136065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f9a6-fb98-42e6-a91f-af8c5219f431 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.136337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f9a6-fb98-42e6-a91f-af8c5219f431 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.137762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 963 bytes} [Wed Jun 15 14:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:49:46.142707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2baa9-e497-44de-a240-539090f71303 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.142997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2baa9-e497-44de-a240-539090f71303 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.143276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2baa9-e497-44de-a240-539090f71303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.161696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-48a2baa9-e497-44de-a240-539090f71303 None None] MFA Rules not processed for user `146205bc397741d2b8c8d69f94523b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:49:46.163397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-48a2baa9-e497-44de-a240-539090f71303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:46.206558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:46.213576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Jun 15 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:49:46.221126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f9a6-fb98-42e6-a91f-af8c5219f431 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:46.232385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f9a6-fb98-42e6-a91f-af8c5219f431 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:46.235770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:46.236443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.236727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.237001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.246061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:46.247531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:46.257121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:46.299838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eb377-6965-4f51-a482-d3bc6ef1d838 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.300255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eb377-6965-4f51-a482-d3bc6ef1d838 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.300416 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eb377-6965-4f51-a482-d3bc6ef1d838 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.301743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 829 bytes} [Wed Jun 15 14:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:49:46.306022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:46.371090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b0e04-01e8-48e5-90c7-a7ae46a096ac service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:46.375630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:46.376527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.376804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.377080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] PATH_INFO: `/v3/users/da7332e474664b678c78f4178fcf2180` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.378343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7332e474664b678c78f4178fcf2180)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:46.379418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:46.379418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:49:46.379418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:49:46.380896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:46.610747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7332e474664b678c78f4178fcf2180'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:46.623787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7332e474664b678c78f4178fcf2180'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:46.624533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7332e474664b678c78f4178fcf2180'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:46.643658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7332e474664b678c78f4178fcf2180'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:46.644469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7332e474664b678c78f4178fcf2180'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:46.648667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:46.729698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:49:46 2022] DELETE /identity/v3/users/da7332e474664b678c78f4178fcf2180 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:49:46.734553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.734852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.735132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.753269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:49:46.754470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:46.814189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:49:46.824677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:46.826088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:46.886249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840cddd-2531-4a5f-8a1a-4b0f4df17eb8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:46.889759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:46.890406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:46.890705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:46.890975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:46.900492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:46.901937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63cc2c-5373-46ea-8f55-94b881976d71 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:46.911416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:47.416887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:49:47.418386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:49:47.430846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace2103-f0f8-4999-a85a-567ffb0925db None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:49:47.435831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] PATH_INFO: `/v3/projects/d217b236624a4653a24d7d60f8ae38ba` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d217b236624a4653a24d7d60f8ae38ba)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:49:47.440420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:49:47.441192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:49:47.609717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd217b236624a4653a24d7d60f8ae38ba', 'request_id': 'req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:47.677496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd217b236624a4653a24d7d60f8ae38ba', 'request_id': 'req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:47.692952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd217b236624a4653a24d7d60f8ae38ba', 'request_id': 'req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:47.704937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] The token cache is being invalidate because project d217b236624a4653a24d7d60f8ae38ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:49:47.705228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:47.705881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-936630d9-be2f-4fc6-a8c0-c8a15694eb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:49:47.707543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:49:47 2022] DELETE /identity/v3/projects/d217b236624a4653a24d7d60f8ae38ba => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:49:56.907132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:57.702022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:35.220826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:35.221422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:35.221422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:35.222796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:35.228148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306149fa-089b-4038-82fa-817a90799017 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:35.228598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306149fa-089b-4038-82fa-817a90799017 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:35.228702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306149fa-089b-4038-82fa-817a90799017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:35.248564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-306149fa-089b-4038-82fa-817a90799017 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:35.249843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-306149fa-089b-4038-82fa-817a90799017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:35.308967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:35.481549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:35.483360 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:35.681879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e7f9-6846-42be-a910-56c133628e73 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:35.687257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:35.687932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:35.688213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:35.688485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:35.698035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:35.699636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588c799-9b71-4547-b5b6-46773ff884bd service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:35.708974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:36.583869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc975c-8e0c-4f94-a44e-a9dfd2ca366c None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:36.584422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc975c-8e0c-4f94-a44e-a9dfd2ca366c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:36.584422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc975c-8e0c-4f94-a44e-a9dfd2ca366c None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:36.586514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:36.591532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fe9b-cf9d-480c-a355-2dc13cc3f5d1 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:36.592002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fe9b-cf9d-480c-a355-2dc13cc3f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:36.592106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fe9b-cf9d-480c-a355-2dc13cc3f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:36.610126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-faf9fe9b-cf9d-480c-a355-2dc13cc3f5d1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:36.611321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-faf9fe9b-cf9d-480c-a355-2dc13cc3f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:36.619340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:36.774633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc975c-8e0c-4f94-a44e-a9dfd2ca366c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:36.788681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc975c-8e0c-4f94-a44e-a9dfd2ca366c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:36.793979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:36.794641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:36.794924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:36.795196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:36.803274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:36.805065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9194-773c-42d4-8dc9-4f2c3770383c service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:36.820152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 757/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:37.044671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb700-1ed5-4a48-8f18-cbe806cb95a5 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:37.044957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb700-1ed5-4a48-8f18-cbe806cb95a5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:37.045260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb700-1ed5-4a48-8f18-cbe806cb95a5 None None] PATH_INFO: `/v3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:37.046634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 760/1517] 10.222.0.64 () {54 vars in 925 bytes} [Wed Jun 15 14:51:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:51:37.057247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a76-54f2-474d-817d-404d5483d13f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:37.057536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a76-54f2-474d-817d-404d5483d13f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:37.057815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a76-54f2-474d-817d-404d5483d13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:37.076587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c84c1a76-54f2-474d-817d-404d5483d13f None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:37.077785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c84c1a76-54f2-474d-817d-404d5483d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:37.139156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 758/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Jun 15 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:46.428892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0096-b57b-45d7-b7b9-ef24c7863f0c None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:46.429416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0096-b57b-45d7-b7b9-ef24c7863f0c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:46.429416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0096-b57b-45d7-b7b9-ef24c7863f0c None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:46.430703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 761/1519] 10.222.0.49 () {54 vars in 960 bytes} [Wed Jun 15 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:46.435789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d906a-4dd6-4ef3-84fb-d65eaae02db6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:46.436227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d906a-4dd6-4ef3-84fb-d65eaae02db6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:46.436475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d906a-4dd6-4ef3-84fb-d65eaae02db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:46.455307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ee5d906a-4dd6-4ef3-84fb-d65eaae02db6 None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:46.456537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ee5d906a-4dd6-4ef3-84fb-d65eaae02db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:46.466023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 759/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Wed Jun 15 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:46.473865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0096-b57b-45d7-b7b9-ef24c7863f0c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:46.488063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0096-b57b-45d7-b7b9-ef24c7863f0c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:46.492958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:46.493590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:46.493871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:46.494147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:46.502551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:46.504187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a76535-7be6-43f9-9f8a-04a818b2d3e1 service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:46.514167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 762/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:48.117834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b111-33e0-4853-9516-5033c8cd6349 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:48.118398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b111-33e0-4853-9516-5033c8cd6349 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:48.118398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b111-33e0-4853-9516-5033c8cd6349 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:48.119829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:48.125592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20008b3-58da-40e1-8370-15426e0e5121 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:48.126027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20008b3-58da-40e1-8370-15426e0e5121 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:48.126167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20008b3-58da-40e1-8370-15426e0e5121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:48.144037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d20008b3-58da-40e1-8370-15426e0e5121 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:48.145235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d20008b3-58da-40e1-8370-15426e0e5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:48.153488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:48.312206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b111-33e0-4853-9516-5033c8cd6349 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:48.327417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b111-33e0-4853-9516-5033c8cd6349 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:48.332772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:48.333410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:48.333691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:48.333969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:48.343007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:48.344616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238d591-19a2-4563-83e6-2488294b9691 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:48.354101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 761/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:49.225613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea466ab-4f67-4a01-94e2-6d206872af59 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:49.226205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea466ab-4f67-4a01-94e2-6d206872af59 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:49.226205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea466ab-4f67-4a01-94e2-6d206872af59 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:49.227555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 14:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:49.233093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe7fb-d3cf-43c7-b224-0bc83b4b5960 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:49.233539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe7fb-d3cf-43c7-b224-0bc83b4b5960 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:49.233667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe7fb-d3cf-43c7-b224-0bc83b4b5960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:49.252126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-831fe7fb-d3cf-43c7-b224-0bc83b4b5960 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:49.253309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-831fe7fb-d3cf-43c7-b224-0bc83b4b5960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:49.261135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:51:49.413487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea466ab-4f67-4a01-94e2-6d206872af59 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:49.427702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea466ab-4f67-4a01-94e2-6d206872af59 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:49.432957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:49.434136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:49.434583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:49.434857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:49.443344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:49.444937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb0a2-80c3-4d5f-9610-7416dcd43d8c service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:49.454953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 765/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:53.525423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:53.525986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:53.525986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:53.528083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:53.533892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bffb-cc9b-4f5e-a59b-28353092487b None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:53.534333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bffb-cc9b-4f5e-a59b-28353092487b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:53.534562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bffb-cc9b-4f5e-a59b-28353092487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:53.552719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-2e53bffb-cc9b-4f5e-a59b-28353092487b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:53.553958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2e53bffb-cc9b-4f5e-a59b-28353092487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:53.561974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:53.600578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:53.602218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:53.660912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e100-d4cf-4c0f-8b6c-d8e7d722fe63 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:53.664430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:53.665068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:53.665347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:53.665620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:53.674340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:53.675749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc1e8-af4e-42c3-b215-6d21e1300467 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:53.680544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:53.685858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 764/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:55.820400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2881-38f0-4dec-801e-6a62cf297268 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:55.820999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2881-38f0-4dec-801e-6a62cf297268 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:55.820999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2881-38f0-4dec-801e-6a62cf297268 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:55.822329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:55.828414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882ae1-f6d1-4c3e-86ec-cf4eb8de7bee None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:55.828874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882ae1-f6d1-4c3e-86ec-cf4eb8de7bee None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:55.828973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882ae1-f6d1-4c3e-86ec-cf4eb8de7bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:55.847985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9c882ae1-f6d1-4c3e-86ec-cf4eb8de7bee None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:55.849192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9c882ae1-f6d1-4c3e-86ec-cf4eb8de7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:55.857669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:55.894182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2881-38f0-4dec-801e-6a62cf297268 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:55.905857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2881-38f0-4dec-801e-6a62cf297268 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:55.909339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:55.909970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:55.910250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:55.910522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:55.919997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:55.921427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e011-e69a-4084-a24d-0a88a510ca8d service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:55.930816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 768/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:51:59.596164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:59.596734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:59.596734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:59.598218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:51:59.603462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a20cb-8d6e-441d-86e3-1d8d1458258c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:59.603915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a20cb-8d6e-441d-86e3-1d8d1458258c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:59.604030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a20cb-8d6e-441d-86e3-1d8d1458258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:59.610722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=62 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:59.623095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7d4a20cb-8d6e-441d-86e3-1d8d1458258c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:51:59.629030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7d4a20cb-8d6e-441d-86e3-1d8d1458258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:59.632204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:51:59.910348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:51:59.912046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:51:59.971926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6bb96-beb0-402b-9110-409fbde7b327 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:51:59.975458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:51:59.976272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:51:59.976553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:51:59.976830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:51:59.986804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:51:59.988803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb459f0-b168-4ab5-b447-358e4835c76e service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:51:59.999161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 767/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:52:02.207828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:52:02.208420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:52:02.208420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:52:02.209814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 14:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:52:02.215736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fae13-a5a2-43cd-8726-bf83c4465e55 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:52:02.216223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fae13-a5a2-43cd-8726-bf83c4465e55 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:52:02.216334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fae13-a5a2-43cd-8726-bf83c4465e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:52:02.235036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ca4fae13-a5a2-43cd-8726-bf83c4465e55 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:52:02.236268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ca4fae13-a5a2-43cd-8726-bf83c4465e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:52:02.244099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:52:02.514788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:52:02.516506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:52:02.530059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f91a-5ac1-4d7f-ab80-69fa579e4fe6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:52:02.533699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:52:02.534331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:52:02.534611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:52:02.534889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:52:02.543872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:52:02.545397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4483f-90b7-4fb8-879c-09e25966ad19 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:52:02.554902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 771/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:52:12.229232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=32 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:12.550775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=8 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:35.032472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f751d-caec-4da0-bad9-615ce646e688 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.033857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f751d-caec-4da0-bad9-615ce646e688 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.034418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f751d-caec-4da0-bad9-615ce646e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.037151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0266e91-6717-4f08-a365-9c10f294939c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.038427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0266e91-6717-4f08-a365-9c10f294939c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.038934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0266e91-6717-4f08-a365-9c10f294939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.073659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d26f751d-caec-4da0-bad9-615ce646e688 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.075306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a0266e91-6717-4f08-a365-9c10f294939c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.075734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d26f751d-caec-4da0-bad9-615ce646e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.080134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a0266e91-6717-4f08-a365-9c10f294939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.092994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 769/1540] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.096666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 772/1541] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.118974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf1ca-1121-4be4-a6c6-ef9cf7b5a515 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.119644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf1ca-1121-4be4-a6c6-ef9cf7b5a515 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.120175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf1ca-1121-4be4-a6c6-ef9cf7b5a515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.123179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.124540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.124840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.150720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c70cf1ca-1121-4be4-a6c6-ef9cf7b5a515 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.152384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c70cf1ca-1121-4be4-a6c6-ef9cf7b5a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.164031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.165780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.171358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 770/1542] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:35.173195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.173718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.174223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.187637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 773/1543] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:35.188468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.206580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949ba7-f51c-4a25-b7d6-5c60c25214d1 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.208194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.209888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.223577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.224305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.224582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.225423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.226161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:35.226465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.227501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:35.227501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:53:35.227501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:53:35.228417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eed171-a6d4-4c8b-80d1-8f73673f4e3b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.236026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 771/1544] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.237328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.250837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b6453-f8f5-407d-aad5-768dfade6175 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.256161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 774/1545] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:35.256161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3513-f37c-4006-8090-987f19cef7c9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.256161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3513-f37c-4006-8090-987f19cef7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.256161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3513-f37c-4006-8090-987f19cef7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.267117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.268268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.268783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.269555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.270520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:35.271052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.273356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.291592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 772/1546] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:35.293006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.299474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-bddc3513-f37c-4006-8090-987f19cef7c9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.299474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bddc3513-f37c-4006-8090-987f19cef7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.310904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c02bf-926b-4557-95a9-ebeb16e51ae9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.318095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 775/1547] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.320766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.321059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.321380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.321710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.322715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.323236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.323734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.324677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.326182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:35.326182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:53:35.326182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:53:35.327833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.362309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.364018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.377258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 776/1548] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.378439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.389053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec3d1-f191-41cd-a0b9-d91e535e4551 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.395543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.396218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.396504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.397333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.398031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.399999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb1e63-686a-48a2-b171-fb2d79dc84f8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.443206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 773/1549] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:35.444205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.508473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82c04-bf3e-49ff-bfa3-f4a29ae3c033 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.513130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.513785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.514066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.514338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.515058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:35.515357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.517030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889afb1-8daf-48eb-a00e-bf26c6e3e05b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.529202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 774/1550] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:35.530432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb808-5189-4aea-ac95-cc9bbb6c366d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.530717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb808-5189-4aea-ac95-cc9bbb6c366d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.530989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb808-5189-4aea-ac95-cc9bbb6c366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.547891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 777/1551] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:35.547891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8550d4f-788e-4efb-9d37-71150f1e848c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.547891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8550d4f-788e-4efb-9d37-71150f1e848c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.547891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8550d4f-788e-4efb-9d37-71150f1e848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.549689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-83cdb808-5189-4aea-ac95-cc9bbb6c366d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.550979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-83cdb808-5189-4aea-ac95-cc9bbb6c366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.567362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d8550d4f-788e-4efb-9d37-71150f1e848c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.568676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d8550d4f-788e-4efb-9d37-71150f1e848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.613202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 775/1552] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.614455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d79d-567b-49d9-9734-8c2a9a0cbfc6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.614743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d79d-567b-49d9-9734-8c2a9a0cbfc6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.615012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d79d-567b-49d9-9734-8c2a9a0cbfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.632952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ae44d79d-567b-49d9-9734-8c2a9a0cbfc6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.633324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 778/1553] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.634230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ae44d79d-567b-49d9-9734-8c2a9a0cbfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.634755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.635057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.635362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.642831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 776/1554] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.644424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.644713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.644987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.654422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.655638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.664426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 779/1555] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.665223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.669245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.671394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.674586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1b407-2520-415c-9939-0c7255e979d3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.679580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.680286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 777/1556] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.680404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.680600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.680825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.681060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.681519 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.682547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:35.682547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:53:35.682547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:53:35.683745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.693746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edde5c7-8871-4ceb-be06-c9117ba6f432 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.698499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.699059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.699335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.699601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.700327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.702204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad98fbd-6a4e-4a75-bc5a-416ba6417b8a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.801563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 780/1557] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:35.802443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.811710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06981-ce67-4bc3-903f-6bc6a39e37c8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.816418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.817054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.817329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.817600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.818273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.820946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338266-98b7-4331-b600-14588eb21cc3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.839966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 778/1558] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:35.841353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.841645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.841933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.849465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:35.860703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.861953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.921893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.922794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:35.931951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd94cd-0dd9-43e3-9436-bc5acaa9d851 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:35.936760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:35.937399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.937683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.938224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.938945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:35.939248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:35.941017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae50fc-8d1e-4c87-be52-cac8131734f2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:35.950575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 781/1560] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:35.953633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.953633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.953633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.955080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:35.956398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2cd40-51c3-4fdb-915e-7991cdeb69dc None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.956687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2cd40-51c3-4fdb-915e-7991cdeb69dc None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.956964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2cd40-51c3-4fdb-915e-7991cdeb69dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.977120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-30b2cd40-51c3-4fdb-915e-7991cdeb69dc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.978374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-30b2cd40-51c3-4fdb-915e-7991cdeb69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.980375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:35.981541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:35.986938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 781/1562] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.988245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:35.988528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:35.988804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:35.992862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 782/1563] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:35.993669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.005337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af95396-3eaf-4e45-bb4c-2842abf790f0 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.010416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.010802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.011082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.011366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.012104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.012519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:36.013700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.013814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:36.021531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 782/1564] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:36.022839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.027083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 783/1565] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:36.027975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.032156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a374ed-863a-4b8d-b52d-0bb9f9911f3c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.036875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.038163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.038374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.038650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.038881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fb9e-9ce1-4631-89c9-df62c34ef73a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.039495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.042087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.043792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.044465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.044743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.045019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.045747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:36.046046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.047621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.061908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 784/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:36.061908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.075472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9037-c9b4-41ce-abe6-f484790bddbf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.080013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.080644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.080925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.081199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.081960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.083540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.093750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 785/1567] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:36.094526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.104807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca959a5-399c-4a63-86dc-a5f60fde6364 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.109315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.109988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.110271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.110545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.111259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.113174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.127656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:36.138309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 783/1568] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.142333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.149872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5658c4-09c9-4d4a-ab8b-9b2479f20104 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.154413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.155040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.155321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.155623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.156373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:36.156776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.158353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.171036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 784/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:36.171845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.181610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cd535-76f5-4723-bf51-e20070339940 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.186269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.186901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.187183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.187458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.188569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:36.188871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.190440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.201805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 785/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:36.202596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.213064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947bc4-d94d-4f0c-bc84-05c8a1d30a42 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.217655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.218277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.222467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.222467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.222467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:36.222467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.222467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.235347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 786/1571] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:53:36.236022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.245588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916837-aac7-4e1c-aedf-abcf67fcada3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.250086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.250714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.251052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.251324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.252069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.253759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.260447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 786/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.261498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.264322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 787/1573] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:36.267628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.275664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5041-c3fb-43f8-96e0-b2b24ab5433f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.327243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a119761-558f-4ae2-977b-16f392e4deff admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.331893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.332563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.332848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.333127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.333828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.336425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.338376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.339046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.339330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.339609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.340683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.341982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.353011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 788/1574] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:36.353830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.363366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91708f7f-db7a-4915-95fd-d8845c3d7d78 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.368977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.369627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.369908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.370185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.370903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.372536 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.373839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:36.384091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 789/1575] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:36.384884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.394528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a7-48fa-4a1f-ab29-64f4aadc337b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.400103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.400751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.401034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.401313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.401999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.403915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.454244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 787/1576] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.455211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.517717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664de5-cb03-4808-98a1-da38f8874fa9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.523441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.524195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.524506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.524832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.525523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.527494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.576707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 790/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.577584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.638130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72d17-5855-4a8c-a8e9-740d4a83e28f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.642773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.643463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.643742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.644044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.644726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.646626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.673309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 788/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.677548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.737653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a837-d575-4581-8f19-f9690f1c2974 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.742889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.743562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.743869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.744151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.744846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.746843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.755506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:36.791150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 791/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.791996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.852077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f563e2-cc36-4577-b61e-781f70dd5e32 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.856732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.857614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.857894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.858168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] PATH_INFO: `/v3/projects/e2e6ed45b8a4412b95f3b8a5ae268a91/users/c35ea03f098c42d9913bf17e75089c2f/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.870059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 789/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:36.872450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.875128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e6ed45b8a4412b95f3b8a5ae268a91, user_id=c35ea03f098c42d9913bf17e75089c2f, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.876301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:36.876301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:53:36.876301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:53:36.878286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.880765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc62975-d4b2-4508-864f-3fad6b04b6f0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:36.886157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:36.887049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:36.887331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:36.887618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] PATH_INFO: `/v3/projects/ec8ec1602ee247fd84cb194882361179/users/94374d8e4dfc4cd5aa0f55bedaf590c7/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:36.902899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8ec1602ee247fd84cb194882361179, user_id=94374d8e4dfc4cd5aa0f55bedaf590c7, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:36.906500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:36.986464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 792/1581] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:36 2022] PUT /identity/v3/projects/e2e6ed45b8a4412b95f3b8a5ae268a91/users/c35ea03f098c42d9913bf17e75089c2f/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:36.987368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:36.999230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 790/1582] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:36 2022] PUT /identity/v3/projects/ec8ec1602ee247fd84cb194882361179/users/94374d8e4dfc4cd5aa0f55bedaf590c7/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:37.000082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.035717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:37.052403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff018c9-b845-4dcd-8026-deafbcd00957 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.063786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb206-e404-4bc8-ac78-a63f64844aa2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.068613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.069876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.070332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.071027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.071824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.074560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.111590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.112200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.112482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.112757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.113596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.115209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.125412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 793/1583] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.126323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.136784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec5e-19ea-4a79-a600-6757d743695e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.141918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.142195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.142474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.142747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.143417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.145329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.169377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 791/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:36 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:37.170373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.181133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff8dc2-643c-4411-87ba-7f583814f500 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.186042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.186718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.187005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.187262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.188252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.190176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.259376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 794/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:37.260379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.269903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1b403-87f8-424e-893d-456e008f9a9e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.274999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.275640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.275948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.276223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.276904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.278847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.286975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 792/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:37.288385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.297761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359487f-874e-4408-ab43-b0d089e17e7e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.302253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.302896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.303916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.304238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.304961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.306550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29957319-7c89-4196-accb-d2dc1e7fb38c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.317254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 793/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.319423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab571d5-6174-418f-8db4-9b3f6cd8223a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.319716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab571d5-6174-418f-8db4-9b3f6cd8223a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.320023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab571d5-6174-418f-8db4-9b3f6cd8223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.338574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8ab571d5-6174-418f-8db4-9b3f6cd8223a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:37.339858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8ab571d5-6174-418f-8db4-9b3f6cd8223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:37.347988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 794/1588] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:37.349337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.349621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.349890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.369004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:37.370131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:37.375046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 795/1589] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:37.375046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.381154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 795/1590] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:37.381794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.386861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dae42-7ce1-4c7c-88b3-816bad30b2ea admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.391701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.392037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a9d3-7bef-492f-ae58-67e8b6556c4e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.392670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.392951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.393258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] PATH_INFO: `/v3/projects/0a9848b2f4ef4bc69ec998f3c5ca7515/users/9d5a0fe74ef54f7e97ca54bca3bebd4a/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.398122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.398796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.399076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.399347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.400146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.401785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.409754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9848b2f4ef4bc69ec998f3c5ca7515, user_id=9d5a0fe74ef54f7e97ca54bca3bebd4a, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.412068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 796/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.416715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.416843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.423400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155abd-3991-4dda-9253-3c567c58ba54 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.427942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.429144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.429428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.429703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.430419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.432032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.442041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 797/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.442821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.452185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc784df-7d74-404d-b606-3801c2d037e8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.457795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.457795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.457795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.457795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.458457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.460321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.470466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 798/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.471210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.481113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb83-e392-4ca9-a107-64094563107f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.485572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.486183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.486464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.486737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.487433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.489010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.499225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 799/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.500022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.501638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:37.518079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 796/1595] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:37 2022] PUT /identity/v3/projects/0a9848b2f4ef4bc69ec998f3c5ca7515/users/9d5a0fe74ef54f7e97ca54bca3bebd4a/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:37.519621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.537105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:37.561742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe445f1-c2a1-41f7-b54c-bd2f9192096c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.588427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357024-ccd9-45b3-83a5-ff74f96e5efa admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.593188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.593852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.594135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.594415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.595830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.596837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.607474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 797/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.608383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.614196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.614942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.615287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.616260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.626292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.627667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.634610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:37.637905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 800/1597] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:37.638832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.648531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924f90-e4a0-4d72-987a-7aebcd23900a service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.654042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.655016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.655448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.655732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.656643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.658269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.669354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ad2e-0e7c-4447-afa7-dc9db50cf052 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.670614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 801/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.673176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.674074 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.674368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.674497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.674655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.684797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.685570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184660a7-8d8b-4324-ae2d-3b36ff15c343 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.686306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.690719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.691390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.691670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.691972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.692715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.695077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.696904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 798/1599] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:37.701252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.706419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 802/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.707065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55dc70-a889-4e12-a124-d3390d087b60 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.708691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.714557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.715256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.715543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.715837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.716577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.718183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7d59b-1d80-4c5e-af95-648d8e28c9f6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.722094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d524950-e75e-467d-ae75-4892444fa7e2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.733060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 799/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.733060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.733060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.733060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.735522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.736475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.736754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.737029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] PATH_INFO: `/v3/projects/8b95f94fbf3f4549a409118264268999/users/00b72500e01d4e36a93465ecb502b339/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.753532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b95f94fbf3f4549a409118264268999, user_id=00b72500e01d4e36a93465ecb502b339, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.756380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.766408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] MFA Rules not processed for user `9d5a0fe74ef54f7e97ca54bca3bebd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:37.767661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:37.844007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 803/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:37 2022] PUT /identity/v3/projects/8b95f94fbf3f4549a409118264268999/users/00b72500e01d4e36a93465ecb502b339/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:37.844007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.844345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 800/1603] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:37.844345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.869236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6812c-bb10-4ff5-b4f5-b4435aad3a66 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.922452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309045e-aa3a-4216-aeb2-e4d25084ddaf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.927881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.928692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.928865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.929148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.929879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.931499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.938317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.939346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.939687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.940003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] PATH_INFO: `/v3/projects/26241ebcdada4c09b9a44f4cdf4a345a/users/04bab9be037241a8bc8ef4f3a656ce02/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.942685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 804/1604] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:37.946567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:37.955886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71450a8-5d9b-4fa5-865e-60deb63de637 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:37.960128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26241ebcdada4c09b9a44f4cdf4a345a, user_id=04bab9be037241a8bc8ef4f3a656ce02, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.961232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:37.962294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:37.962599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:37.962882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] PATH_INFO: `/v3/projects/a5bf248f413c43d49f7ff03dce6febad/users/fd48e2130723461d8d09484cb3b7a0df/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:37.963128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:37.978476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bf248f413c43d49f7ff03dce6febad, user_id=fd48e2130723461d8d09484cb3b7a0df, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:37.981201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d08a0-1f06-440f-83de-c7865f9259de admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.086373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 801/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:37 2022] PUT /identity/v3/projects/26241ebcdada4c09b9a44f4cdf4a345a/users/04bab9be037241a8bc8ef4f3a656ce02/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:38.086965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.114771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 805/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:37 2022] PUT /identity/v3/projects/a5bf248f413c43d49f7ff03dce6febad/users/fd48e2130723461d8d09484cb3b7a0df/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:38.117864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28c61-2e93-427b-9b3b-9018a767da96 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.118169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28c61-2e93-427b-9b3b-9018a767da96 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.119116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28c61-2e93-427b-9b3b-9018a767da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.136239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:38.152534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-acf28c61-2e93-427b-9b3b-9018a767da96 None None] MFA Rules not processed for user `00b72500e01d4e36a93465ecb502b339`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.153822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-acf28c61-2e93-427b-9b3b-9018a767da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.159890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:38.170731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d31e4-a598-4d5b-8782-57d2c254a420 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.175414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.176437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.176811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.177195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] PATH_INFO: `/v3/projects/b2a6d6e288714256b0800fa7f9e27618/users/8177948cd6074d1f8240500be6bcd424/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.196798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a6d6e288714256b0800fa7f9e27618, user_id=8177948cd6074d1f8240500be6bcd424, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:38.200599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25300650-61c3-4210-a40c-210ad2153c3a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.242397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 806/1607] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.243745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ee40-1251-424d-ad61-da46d72b2861 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.244067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ee40-1251-424d-ad61-da46d72b2861 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.244337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ee40-1251-424d-ad61-da46d72b2861 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.245610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 807/1608] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jun 15 14:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:53:38.246320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ee40-1251-424d-ad61-da46d72b2861 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.259290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ee40-1251-424d-ad61-da46d72b2861 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.263706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.264599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.264881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.265152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] PATH_INFO: `/v3/projects/795dbfaaab4b48dcab1c00e9430d9642/users/10942dbd553e44dcb49a48de4dd65d1d/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.280174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795dbfaaab4b48dcab1c00e9430d9642, user_id=10942dbd553e44dcb49a48de4dd65d1d, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:38.282920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab0a01-a633-4e51-9e5e-b44426a12ab1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.322335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 802/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:38 2022] PUT /identity/v3/projects/b2a6d6e288714256b0800fa7f9e27618/users/8177948cd6074d1f8240500be6bcd424/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:38.327335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.327703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.328008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.359525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] MFA Rules not processed for user `04bab9be037241a8bc8ef4f3a656ce02`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.360883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.382359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 808/1610] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:38 2022] PUT /identity/v3/projects/795dbfaaab4b48dcab1c00e9430d9642/users/10942dbd553e44dcb49a48de4dd65d1d/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:38.384402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7359-4779-4bf4-8db7-1f9d1c7448ab None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.385015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7359-4779-4bf4-8db7-1f9d1c7448ab None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.385729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7359-4779-4bf4-8db7-1f9d1c7448ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.413241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d80e7359-4779-4bf4-8db7-1f9d1c7448ab None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.415788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d80e7359-4779-4bf4-8db7-1f9d1c7448ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.455254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 803/1611] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.456134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.525373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 809/1612] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.525373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc22e3-77af-475d-8c7f-d91c71803cea None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.525373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc22e3-77af-475d-8c7f-d91c71803cea None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.525373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc22e3-77af-475d-8c7f-d91c71803cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.536110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfd6d9-5659-4df5-8192-ba01b0c1b1bd None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.541500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.542158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.542437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.542712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.543400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:38.545417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.548644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-22dc22e3-77af-475d-8c7f-d91c71803cea None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.549838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-22dc22e3-77af-475d-8c7f-d91c71803cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.629419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 810/1613] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.629419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8fe0-e6ef-4cb9-b404-160d665d5823 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.629419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8fe0-e6ef-4cb9-b404-160d665d5823 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.629419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8fe0-e6ef-4cb9-b404-160d665d5823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.643321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a69b8fe0-e6ef-4cb9-b404-160d665d5823 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.644482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a69b8fe0-e6ef-4cb9-b404-160d665d5823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.654892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 811/1614] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.668758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.668758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.668758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.685095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:38.687340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:38.698232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 812/1615] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:38.699408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.702892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 804/1616] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:38 2022] POST /identity/v3/projects => generated 363 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:38.703937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.704898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:38.739757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:38.773400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803c30-3865-43d5-86ab-bbb90d772143 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.777671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.778339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.778622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.778954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.799200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c0b3-60ab-47a2-8a02-783469b752b9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.842742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:38.844263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.849800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.850658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.850944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.851214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.854325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 805/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:38.855143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:38.937212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b47-7d3f-4b75-8525-4cd06f5fbf63 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:38.957873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:38.960402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:38.960596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:38.964705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:38.964705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:38.964906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:38.991684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 813/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:38.991684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.005642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c95c-ea2a-4af9-8b67-dd3b79599312 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.019719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.020880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.020880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.021309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.031483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.033107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.060040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 814/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:39.062226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.076675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.084543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.091599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bad8-af77-46e7-9435-c60f061df3ce service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.098041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.099707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.099707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.099707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.101165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.103979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.115372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 806/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:39.118117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.134526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0412b-6210-4541-a9e1-8aa9b6d6ab25 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.138397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.139116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.139487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.139936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.150405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.152163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.162144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 807/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:39.263583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 815/1622] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:39 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:39.271463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.316235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90c60-e443-4b05-91d2-976f06a8a915 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.330494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.331541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.332060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.332543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.335000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.337850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8fb95-e970-44c6-851f-8bcd7693aa6c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.394380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.394608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 808/1623] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:39.411528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872cc6-80c4-4a2d-a7cd-7a95a0641c2e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.427081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.427688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.428017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.428311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] PATH_INFO: `/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.465077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bdc37c6a9f4453b3fc672a77c710fd, user_id=06f6aac6fe5a44d9aa1c66a93b5b1ebf, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.467852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.532336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbe8b-52f8-45bd-bb73-d50d34dcf377 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.532628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbe8b-52f8-45bd-bb73-d50d34dcf377 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.533028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbe8b-52f8-45bd-bb73-d50d34dcf377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.547376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:39.589030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 816/1624] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:39 2022] PUT /identity/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:39.593070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.605166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-afbcbe8b-52f8-45bd-bb73-d50d34dcf377 None None] MFA Rules not processed for user `c35ea03f098c42d9913bf17e75089c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:39.605166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-afbcbe8b-52f8-45bd-bb73-d50d34dcf377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:39.635976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:39.743692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb85c3-9f52-4954-8cf8-91792660f834 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.759247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.760288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.760877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.761166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.762682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.764453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.767658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 809/1625] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:39.776668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834a01-8c31-4305-846a-672682915478 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.776975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834a01-8c31-4305-846a-672682915478 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.777241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834a01-8c31-4305-846a-672682915478 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.779000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 810/1626] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jun 15 14:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:53:39.783559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe504e-98f7-4053-a3d2-de90fe11cde2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.783696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe504e-98f7-4053-a3d2-de90fe11cde2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.784269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe504e-98f7-4053-a3d2-de90fe11cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.796833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 817/1627] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:39.800409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:39.831056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276578-faf9-48d5-8d12-5ef9508b0c64 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:39.837999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:39.839213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.839719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.840286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] PATH_INFO: `/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.844974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bdc37c6a9f4453b3fc672a77c710fd, user_id=06f6aac6fe5a44d9aa1c66a93b5b1ebf, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:39.846442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e3fe504e-98f7-4053-a3d2-de90fe11cde2 None None] MFA Rules not processed for user `c35ea03f098c42d9913bf17e75089c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:39.848653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e3fe504e-98f7-4053-a3d2-de90fe11cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:39.850442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958a165-13f9-4174-bc72-8c6c3de57739 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:39.870240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 818/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:39 2022] PUT /identity/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:39.880066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 811/1629] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:39.880520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.880520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.880520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.884922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ddeb-7844-4a07-8d63-2fba12ca3f5a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:39.885272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ddeb-7844-4a07-8d63-2fba12ca3f5a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:39.885633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ddeb-7844-4a07-8d63-2fba12ca3f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:39.904111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:39.905618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:39.930096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1694ddeb-7844-4a07-8d63-2fba12ca3f5a None None] MFA Rules not processed for user `06f6aac6fe5a44d9aa1c66a93b5b1ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:39.931783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1694ddeb-7844-4a07-8d63-2fba12ca3f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:40.057664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 819/1630] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jun 15 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:40.064913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:40.076397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 812/1631] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:40.077747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404eb3d-a292-4ec3-8e38-ce0957d85c77 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.078146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404eb3d-a292-4ec3-8e38-ce0957d85c77 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.078525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404eb3d-a292-4ec3-8e38-ce0957d85c77 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.081522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 813/1632] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jun 15 14:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:53:40.086952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.087147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa613-82a9-498f-8324-11c96faf9b74 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:40.087443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.087832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.098929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:40.098929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.098929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.098929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.114295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:40.116267 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:40.129498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 814/1633] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:40.130998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:40.180868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:40.183507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:40.190946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:40.201346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670308-dbb7-4b66-8bee-06c5bfff2391 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:40.205778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 820/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:40.213504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:40.214345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.215249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.215629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.234420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:40.236726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfe0ef-39da-40b7-8940-0a326120f690 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:40.253907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 815/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:40.293528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:40.308386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02e57-beec-4f6e-aecf-b1a9ff350e82 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:40.314650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:40.316057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.316753 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.317307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.343857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44127c6-abcc-4d5c-bc78-393a9c22d9e2 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.344350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44127c6-abcc-4d5c-bc78-393a9c22d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.344740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44127c6-abcc-4d5c-bc78-393a9c22d9e2 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.346449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:40.347969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:40.349370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 816/1636] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jun 15 14:53:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:53:40.356710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.361308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.361308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.374624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 821/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:40.429351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:40.447904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:40.466000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 817/1638] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:40.482246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:40.483869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:40.582012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f44a-dcc7-4913-aa61-5a854f84ae78 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:40.593000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:40.600862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.600862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.600862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.636145 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:40.641522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:40.676775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:40.696619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7998-daae-4ff1-9f54-6c70e686a278 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:40.711997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 822/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:40.720390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:40.724062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:40.724062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:40.736082 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:40.874226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:40.875719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7008c6-bc23-4985-80dd-b9f31ce2571b service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:40.892534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 818/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:53:40.943778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:41.202646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e393-2062-47ca-9688-8efde0a20b7f service glance] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:41.202646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:41.202646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.202646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.206697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] PATH_INFO: `/v3/users/9d5a0fe74ef54f7e97ca54bca3bebd4a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.206697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5a0fe74ef54f7e97ca54bca3bebd4a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:41.206697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:41.312572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:41.379881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baba45-45c8-4412-bdbc-31079f206d97 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.380355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baba45-45c8-4412-bdbc-31079f206d97 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.380476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baba45-45c8-4412-bdbc-31079f206d97 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.382454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 819/1641] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jun 15 14:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:53:41.389318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.390383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.390943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.398442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5a0fe74ef54f7e97ca54bca3bebd4a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:41.406792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5a0fe74ef54f7e97ca54bca3bebd4a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:41.407580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5a0fe74ef54f7e97ca54bca3bebd4a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:41.422133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5a0fe74ef54f7e97ca54bca3bebd4a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:41.423223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-22feedc9-4f08-47f7-902c-fd2aa1202c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5a0fe74ef54f7e97ca54bca3bebd4a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:41.444973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:41.446196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:41.511663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 823/1642] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:53:40 2022] DELETE /identity/v3/users/9d5a0fe74ef54f7e97ca54bca3bebd4a => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:41.516494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.517347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.517642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.547607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 820/1643] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:41.586090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:41.587388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:41.589388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:41.592761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:41.650943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e6f1e-88ad-48f3-8f39-916d6d345780 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:41.714070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 824/1644] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:41.730395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:41.793313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:41.794371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.794371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.795030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.804618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:41.806704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b04d0-00d5-408f-9abb-c695b7662146 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:41.855619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 821/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:41.957325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b211c61-fd05-47ed-9cce-e6733f053369 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:41.964801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:41.965558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:41.965940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:41.966311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:41.980258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:41.982195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae369f9-9094-41e4-84ae-1a722cd892e2 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:42.005397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 825/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:42.775138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:42.835218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d97c4e-c867-4ca2-b662-4addd4dc0252 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:42.835718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d97c4e-c867-4ca2-b662-4addd4dc0252 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:42.835787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d97c4e-c867-4ca2-b662-4addd4dc0252 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:42.838703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 822/1647] 10.222.0.49 () {54 vars in 960 bytes} [Wed Jun 15 14:53:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:53:42.845781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:42.846102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:42.846341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:42.883703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:42.885572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:43.064565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d97c4e-c867-4ca2-b662-4addd4dc0252 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:43.067744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 826/1648] 10.222.0.49 () {58 vars in 1057 bytes} [Wed Jun 15 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:43.095308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d97c4e-c867-4ca2-b662-4addd4dc0252 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:43.105251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:43.106297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:43.107111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:43.107505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:43.109953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:43.126054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:43.129498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a505-7392-43ce-a06e-3007eb50843e service placement] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:43.147474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 823/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:43.660633 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:43.669888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:43.711737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1109-803a-4ffe-8301-714908e53342 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:43.718160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:43.719542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:43.719991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:43.720674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] PATH_INFO: `/v3/projects/0a9848b2f4ef4bc69ec998f3c5ca7515` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:43.722224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9848b2f4ef4bc69ec998f3c5ca7515)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:43.723468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: WARNING py.warnings [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:43.723468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: warnings.warn(msg) Jun 15 14:53:43.723468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: Jun 15 14:53:43.725748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:43.895553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9848b2f4ef4bc69ec998f3c5ca7515', 'request_id': 'req-67ac81a4-cfad-42e2-b41b-c0d0920815ca'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:44.012797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9848b2f4ef4bc69ec998f3c5ca7515', 'request_id': 'req-67ac81a4-cfad-42e2-b41b-c0d0920815ca'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:44.061241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9848b2f4ef4bc69ec998f3c5ca7515', 'request_id': 'req-67ac81a4-cfad-42e2-b41b-c0d0920815ca'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:44.075405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] The token cache is being invalidate because project 0a9848b2f4ef4bc69ec998f3c5ca7515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:53:44.079001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:44.080651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-67ac81a4-cfad-42e2-b41b-c0d0920815ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:44.085283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 827/1650] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:53:43 2022] DELETE /identity/v3/projects/0a9848b2f4ef4bc69ec998f3c5ca7515 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:44.090432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:44.090904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:44.090986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:44.124664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:44.126145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:44.138636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:44.391743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 824/1651] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:44.406274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:44.406567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:44.406848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:44.430906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:44.450233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:44.451745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:44.474694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 828/1652] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:44.475977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:44.503581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe3ca-f184-4e04-98c6-29afe0fd93fa None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:44.527054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:44.528201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:44.528815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:44.529288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:44.531418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:53:44.532062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:44.535283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:44.559003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 825/1653] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:53:44.560391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:44.573345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff7f6-cbf3-4b9a-afcc-f6e0bb8cacec None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:44.581502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:44.592244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:44.592244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:44.592244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:44.592244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:44.592244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:44.736269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:44.743351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 829/1654] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:44 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:44.750564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7068c-54d0-445b-80c0-39cd7ea763c0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:44.883637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:44.884484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:44.884994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:44.885510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:44.886238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:44.888232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:45.041856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:45.045683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 826/1655] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:44 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:45.062398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc957ae-d96d-4aba-bed6-086143e330ff admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:45.078885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:45.080741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:45.080741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:45.080741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:45.081145 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:45.082772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:45.114541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 830/1656] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:45.119605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:45.137943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a3fb-aea1-479b-a19e-79ef1718bcad admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:45.165244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:45.165944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:45.167571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:45.167571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:45.167571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:45.172681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075f319-385a-48ff-8030-3db638fdc97a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:45.207225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 827/1657] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:45.210257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:45.229141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82961c8c-561c-4374-a8b7-fa57156a6200 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:45.246484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:45.248576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:45.250008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:45.251748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] PATH_INFO: `/v3/projects/230ac4bd8aaf490b966eed742f52823c/users/8d57d59611cc46cf878f1f51d92f2c50/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:45.314987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230ac4bd8aaf490b966eed742f52823c, user_id=8d57d59611cc46cf878f1f51d92f2c50, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:45.318317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:45.454536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 831/1658] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:45 2022] PUT /identity/v3/projects/230ac4bd8aaf490b966eed742f52823c/users/8d57d59611cc46cf878f1f51d92f2c50/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:45.470977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:45.472738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:45.473162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:45.601692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] MFA Rules not processed for user `8d57d59611cc46cf878f1f51d92f2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:45.602957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:45.929453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 828/1659] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:45.930947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:46.114327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fc4d-125f-432c-92b0-94921b2abf21 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:46.123480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:46.124300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:46.124579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:46.124856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:46.125674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:46.147489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:46.273646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 832/1660] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:53:45 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:46.278031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:46.286815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:46.298710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316e35a-1290-43e6-8114-e12eb9c9b0f5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:46.396263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:46.397334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:46.397691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:46.398063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:46.398836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:46.401096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:46.550783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 829/1661] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:53:46 2022] POST /identity/v3/users => generated 299 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:53:46.564686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:46.611379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262cf7b-8bf2-4019-8fe2-bfb3b53efa88 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:46.630179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:46.634102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:46.634771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:46.635128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:46.636097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:46.650222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:46.683436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:46.683635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 833/1662] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:46.699251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ebc52-65c8-4ee3-9948-18b37021fc7c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:46.731506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:46.733755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:46.734253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:46.734732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] PATH_INFO: `/v3/projects/1707254c6055453389c47dad628b7610/users/bc8f466e8d654d3b92e4f18e4c557964/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:46.799769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1707254c6055453389c47dad628b7610, user_id=bc8f466e8d654d3b92e4f18e4c557964, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:46.806795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:46.980210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 830/1663] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:46 2022] PUT /identity/v3/projects/1707254c6055453389c47dad628b7610/users/bc8f466e8d654d3b92e4f18e4c557964/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:46.984518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:47.016380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95e45-6016-48a7-bd61-42f72a5080e7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:47.184075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:47.185880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:47.186683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:47.187385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:47.188671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:47.197739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f41c4-993d-469e-845e-173ef1edaa47 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:47.214984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 834/1664] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:53:47.219356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:47.272052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f193-bd25-426b-bf14-dc97b7ac92a7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:47.293097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:47.296574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:47.297886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:47.298636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] PATH_INFO: `/v3/projects/1707254c6055453389c47dad628b7610/users/bc8f466e8d654d3b92e4f18e4c557964/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:47.304674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1707254c6055453389c47dad628b7610, user_id=bc8f466e8d654d3b92e4f18e4c557964, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:47.313835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:47.344520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 831/1665] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:53:47 2022] PUT /identity/v3/projects/1707254c6055453389c47dad628b7610/users/bc8f466e8d654d3b92e4f18e4c557964/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:47.356278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:47.356796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:47.359364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:47.398241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:47.420359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] MFA Rules not processed for user `bc8f466e8d654d3b92e4f18e4c557964`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:47.421861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:47.659979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 835/1666] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:47.798043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:47.799987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:47.951317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4d99-6506-40ae-9282-ba8332298127 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:47.963995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:47.964875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:47.965161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:47.970714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:47.993798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:47.997346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342570d-984a-4922-83ed-3475e8f68901 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:48.025035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 832/1667] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:53:48.102760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:48.371837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aacf0-d8d0-4547-ac25-185b780b7edd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:48.384847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:48.385892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:48.387437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:48.387724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] PATH_INFO: `/v3/users/8d57d59611cc46cf878f1f51d92f2c50` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:48.390817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d57d59611cc46cf878f1f51d92f2c50)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:48.397337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:48.787332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d57d59611cc46cf878f1f51d92f2c50'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:48.827933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d57d59611cc46cf878f1f51d92f2c50'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:48.831609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d57d59611cc46cf878f1f51d92f2c50'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:48.858922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d57d59611cc46cf878f1f51d92f2c50'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:48.859739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-beb974cc-5a3e-4da9-8a5d-bd7a2cecc766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d57d59611cc46cf878f1f51d92f2c50'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:48.967170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:48.967170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:48.967170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:48.971073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 836/1668] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:53:48 2022] DELETE /identity/v3/users/8d57d59611cc46cf878f1f51d92f2c50 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:48.993552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:48.994390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:48.994600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:49.058954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:49.060516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:49.072786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:49.082256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:49.281076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 833/1669] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:49.308938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 837/1670] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:49.331302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:49.333836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:49.354066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:49.478034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:49.528965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e418e9-f6c8-4b10-9e05-326948f55da9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:49.546908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:49.546908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:49.546908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:49.546908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:49.586535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:49.593566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616774-0aa8-47c5-95d3-e4a3bd0a6845 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:49.636684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 834/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:49.898608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:49.900376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:50.135150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2f6f1-71ae-4774-8305-07ee85f52420 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:50.142103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:50.143013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:50.143430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:50.149539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:50.164961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:50.168754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:50.199759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 838/1672] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:53:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:53:51.650872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262485e-3133-4466-be77-cdafc315570a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:51.651936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262485e-3133-4466-be77-cdafc315570a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:51.652233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262485e-3133-4466-be77-cdafc315570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:51.788645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-8262485e-3133-4466-be77-cdafc315570a None None] MFA Rules not processed for user `94374d8e4dfc4cd5aa0f55bedaf590c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:51.792125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8262485e-3133-4466-be77-cdafc315570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:51.993722 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 835/1673] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:53:52.010786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:52.013230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:52.206549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39dbf-3c1d-447e-abbf-562a7b4e3576 service swift] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:52.231005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:52.243336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:52.244009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:52.251136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:52.286289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:52.289974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:52.334228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 839/1674] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:53.441529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:53.442113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:53.442113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:53.501838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:53.503242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:53.546296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 836/1675] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Jun 15 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:53.592970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:53.617530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe37-dc21-47cd-89ed-883dfffe9246 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:53.626533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:53.627503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:53.628108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:53.642258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:53.669332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:53.671521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:53.718693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 840/1676] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:53.862568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:53.865575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:53.915777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8c140-3511-4730-adf9-7edf5cd07ff5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:53.950113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:53.952537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:53.953005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:53.955401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] PATH_INFO: `/v3/projects/230ac4bd8aaf490b966eed742f52823c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:53.958990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230ac4bd8aaf490b966eed742f52823c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:53.969970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:54.274272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230ac4bd8aaf490b966eed742f52823c', 'request_id': 'req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:54.395044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230ac4bd8aaf490b966eed742f52823c', 'request_id': 'req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:54.407306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230ac4bd8aaf490b966eed742f52823c', 'request_id': 'req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:54.447266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] The token cache is being invalidate because project 230ac4bd8aaf490b966eed742f52823c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:53:54.447962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:54.450117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:54.459967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:54.461905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:54.462121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 837/1677] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:53:53 2022] DELETE /identity/v3/projects/230ac4bd8aaf490b966eed742f52823c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:54.463204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:54.469942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:54.513977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e26c-84a8-41f3-b443-276ef34adf6d service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:54.525772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:54.574215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:54.749394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eafbe8-6388-46e0-a5c8-dc5a98e4a892 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:54.772251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:54.773369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:54.773656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:54.773929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] PATH_INFO: `/v3/users/bc8f466e8d654d3b92e4f18e4c557964` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:54.777799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:54.778703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:54.778980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:54.779251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] PATH_INFO: `/v3/users/00b72500e01d4e36a93465ecb502b339` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:54.783398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8f466e8d654d3b92e4f18e4c557964)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:54.790965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: WARNING py.warnings [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:54.790965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: warnings.warn(msg) Jun 15 14:53:54.790965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: Jun 15 14:53:54.794011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b72500e01d4e36a93465ecb502b339)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:54.800679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:54.808046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:55.181226 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b72500e01d4e36a93465ecb502b339'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.239843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b72500e01d4e36a93465ecb502b339'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.245124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b72500e01d4e36a93465ecb502b339'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.293702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8f466e8d654d3b92e4f18e4c557964'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.298347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8f466e8d654d3b92e4f18e4c557964'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.313932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b72500e01d4e36a93465ecb502b339'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.317707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e67df86d-5e50-49e9-a31f-21171dea126c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b72500e01d4e36a93465ecb502b339'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.339224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8f466e8d654d3b92e4f18e4c557964'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.412645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 841/1678] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:53:54 2022] DELETE /identity/v3/users/00b72500e01d4e36a93465ecb502b339 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:55.417273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:55.426787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:55.426787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:55.471364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:55.474832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:55.543531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8f466e8d654d3b92e4f18e4c557964'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.570456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8f466e8d654d3b92e4f18e4c557964'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:55.603188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 838/1679] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:53:54 2022] DELETE /identity/v3/users/bc8f466e8d654d3b92e4f18e4c557964 => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:53:55.702573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 842/1680] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:55.758635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:55.762420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:55.927201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:55.929237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:55.952694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d974f-1251-4743-b5a7-2f7e79247d08 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:55.968408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:55.969088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:55.969370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:55.969646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:55.978829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f8bb0-9bc5-425a-9c8d-a2f6369d06bd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:56.127731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:56.228543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:56.229697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:56.229812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:56.230448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] PATH_INFO: `/v3/users/04bab9be037241a8bc8ef4f3a656ce02` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:56.232023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bab9be037241a8bc8ef4f3a656ce02)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:56.251630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:56.299970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:56.303562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea97de-ea36-48d7-8b27-1fd0bc31e2b2 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:56.334250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 839/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:56.590433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bab9be037241a8bc8ef4f3a656ce02'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:56.612529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bab9be037241a8bc8ef4f3a656ce02'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:56.614646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bab9be037241a8bc8ef4f3a656ce02'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:56.672935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bab9be037241a8bc8ef4f3a656ce02'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:56.677084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bab9be037241a8bc8ef4f3a656ce02'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:53:56.851352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 843/1682] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:53:55 2022] DELETE /identity/v3/users/04bab9be037241a8bc8ef4f3a656ce02 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:53:56.860182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274375-7d76-45f9-a642-06061d6606eb None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:56.860717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274375-7d76-45f9-a642-06061d6606eb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:56.860717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274375-7d76-45f9-a642-06061d6606eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:56.922699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e1274375-7d76-45f9-a642-06061d6606eb None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:56.932946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e1274375-7d76-45f9-a642-06061d6606eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:57.201230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:57.301134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 840/1683] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:57.922395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:57.928574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:58.073991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41aea-260e-454c-a5d1-add5aaa8968d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:58.080818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:58.082958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:58.083453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:58.084454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:58.102587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:58.121934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:58.163521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 844/1684] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:58.265090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:58.265644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:58.265644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:58.352383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] MFA Rules not processed for user `fd48e2130723461d8d09484cb3b7a0df`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:53:58.353776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:58.572329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 841/1685] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:53:58.602149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:58.604814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:58.815794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:58.859212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dce0-f535-48d3-a40c-b122c1929460 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:58.866051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:58.866824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:58.867132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:58.867500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:58.878441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:58.880587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:58.908133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 845/1686] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:53:59.880064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:59.882273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:59.915642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc3c4-6157-488e-87e0-15faa88925b6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:59.918263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:53:59.921272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:53:59.929388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:59.931365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:59.931993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:59.932431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] PATH_INFO: `/v3/projects/1707254c6055453389c47dad628b7610` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:59.935236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1707254c6055453389c47dad628b7610)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:59.939907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:53:59.968700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61aa23-7f3c-4350-9811-7c4915e6f984 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:53:59.988375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:53:59.994787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:53:59.994787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:53:59.994787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] PATH_INFO: `/v3/projects/8b95f94fbf3f4549a409118264268999` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:53:59.994787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b95f94fbf3f4549a409118264268999)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:53:59.994787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:00.249046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1707254c6055453389c47dad628b7610', 'request_id': 'req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.277824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b95f94fbf3f4549a409118264268999', 'request_id': 'req-50b329a5-22d6-48ce-9358-ec1301278a8e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.305707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1707254c6055453389c47dad628b7610', 'request_id': 'req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.326328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1707254c6055453389c47dad628b7610', 'request_id': 'req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.344342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:00.360000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] The token cache is being invalidate because project 1707254c6055453389c47dad628b7610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:00.361384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.363380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b2d7fe71-2d85-41ed-82bd-8fb8ae636b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.367247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 842/1687] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:53:59 2022] DELETE /identity/v3/projects/1707254c6055453389c47dad628b7610 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:00.369320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:00.369810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:00.371631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:00.391347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b95f94fbf3f4549a409118264268999', 'request_id': 'req-50b329a5-22d6-48ce-9358-ec1301278a8e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.400808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b95f94fbf3f4549a409118264268999', 'request_id': 'req-50b329a5-22d6-48ce-9358-ec1301278a8e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.440913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] The token cache is being invalidate because project 8b95f94fbf3f4549a409118264268999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:00.442218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.445271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-50b329a5-22d6-48ce-9358-ec1301278a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:00.450607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 846/1688] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:53:59 2022] DELETE /identity/v3/projects/8b95f94fbf3f4549a409118264268999 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:00.451024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] MFA Rules not processed for user `8177948cd6074d1f8240500be6bcd424`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:00.462623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:00.463016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058cffc-3883-4cb1-a891-e580dbf57679 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:00.463016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058cffc-3883-4cb1-a891-e580dbf57679 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:00.463016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058cffc-3883-4cb1-a891-e580dbf57679 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:00.463016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 847/1689] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:54:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:54:00.474730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:00.477612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:00.477964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:00.571414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:00.572969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:00.671898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 843/1690] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:00.672990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:00.676755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:00.754042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 848/1691] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:00.754042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:00.755256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:00.780421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930e27-c9a8-43b1-81c2-a504f816b79e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:00.800849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:00.801778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:00.802059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:00.802331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] PATH_INFO: `/v3/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:00.806958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f6aac6fe5a44d9aa1c66a93b5b1ebf)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:00.808998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:00.953220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3178-d827-4145-afb7-aa9c0a6dbf61 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:00.985816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:00.985816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:00.985816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:00.985816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] PATH_INFO: `/v3/projects/26241ebcdada4c09b9a44f4cdf4a345a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:00.986089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26241ebcdada4c09b9a44f4cdf4a345a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:00.986089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:01.105486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f6aac6fe5a44d9aa1c66a93b5b1ebf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.131554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f6aac6fe5a44d9aa1c66a93b5b1ebf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.138415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f6aac6fe5a44d9aa1c66a93b5b1ebf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.163196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:01.173237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26241ebcdada4c09b9a44f4cdf4a345a', 'request_id': 'req-4f213bea-60aa-4b3a-bcae-b37114571162'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.190034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f6aac6fe5a44d9aa1c66a93b5b1ebf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.203417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f6aac6fe5a44d9aa1c66a93b5b1ebf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.287575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26241ebcdada4c09b9a44f4cdf4a345a', 'request_id': 'req-4f213bea-60aa-4b3a-bcae-b37114571162'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.298937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26241ebcdada4c09b9a44f4cdf4a345a', 'request_id': 'req-4f213bea-60aa-4b3a-bcae-b37114571162'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.339326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] The token cache is being invalidate because project 26241ebcdada4c09b9a44f4cdf4a345a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:01.339616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.344615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4f213bea-60aa-4b3a-bcae-b37114571162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:01.349049 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 844/1692] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:00 2022] DELETE /identity/v3/projects/26241ebcdada4c09b9a44f4cdf4a345a => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:01.351394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eda-c6f0-4295-ba73-02016c043ebf None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:01.351685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eda-c6f0-4295-ba73-02016c043ebf None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:01.351973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eda-c6f0-4295-ba73-02016c043ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:01.369481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 849/1693] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:00 2022] DELETE /identity/v3/users/06f6aac6fe5a44d9aa1c66a93b5b1ebf => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:01.371213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:01.375527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:01.451706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-661f0eda-c6f0-4295-ba73-02016c043ebf None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:01.465466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-661f0eda-c6f0-4295-ba73-02016c043ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:01.534627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:01.710120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45ccc-e55a-4b80-a640-bc9540f95c8b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:01.733716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:01.734403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:01.734688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:01.734966 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:01.750623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:01.789472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 845/1694] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:01.790931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde531-5dcb-4857-821b-0a2f36a3fe23 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:01.791232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde531-5dcb-4857-821b-0a2f36a3fe23 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:01.791519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde531-5dcb-4857-821b-0a2f36a3fe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:01.857180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e3dde531-5dcb-4857-821b-0a2f36a3fe23 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:01.858488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e3dde531-5dcb-4857-821b-0a2f36a3fe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:01.872902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:01.874563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb68b-a51e-46da-ab6c-764dfac575d7 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:01.900175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 850/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:01.901812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:01.902066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:01.902346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:01.977249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:01.987327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:02.046470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 846/1696] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:02.047892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.048200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.048480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.102231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] MFA Rules not processed for user `94374d8e4dfc4cd5aa0f55bedaf590c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:02.102938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:02.166519 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 851/1697] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:02.167945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.172677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:02.223042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025e76-628e-43df-b2b2-4f0b18ac5784 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.250923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.251897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.252343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.252754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.285173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.287636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b0f7-c7a6-44a5-be62-e45adf8b8b67 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.295341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 847/1698] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:02.295341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.336162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94017c42-5c53-4d5f-ba0d-76729c19c176 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.339414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 852/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:02.346653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.347197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.347625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.347792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.349928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.350223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.350502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.351347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:02.351660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.353452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.402867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:02.404162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:02.424604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 848/1700] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:02.430445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.449774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 853/1701] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:02.450735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.473377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab539f-8c14-461f-8c3b-aef80e2feea3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.480666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946659d-cdb0-45ad-ab4a-c1124b858c51 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.492238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.496821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.498484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.498781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.499598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.510240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.510471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.510944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.511232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.511511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.512284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:02.512597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.520201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.592466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 854/1702] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:02.593861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.622883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc926-e836-415e-a314-6aa52cdc4db5 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.635626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.637129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.637249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.637472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.646553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.646553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.692778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 849/1703] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/projects => generated 371 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:02.698462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.795026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:02.801843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 855/1704] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:02.806276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:02.956843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449777-fc2e-4b1f-b111-119f6d876f3a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:02.971707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:02.972824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:02.973332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:02.973810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:02.975375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:02.977782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:02.982443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e39150-7096-47ba-988b-fa5bf3014879 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.007911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.008642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.008910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.009194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.015217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.025026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.102042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 856/1705] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:03.106256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.129087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d6ec1-85f2-459e-a0c1-5a7655693832 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.144372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.145193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.145672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.146574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.147775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.151354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.153399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:03.181379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 857/1706] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:03.187563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.209303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45b17d-a86b-469d-997b-dede795d8f75 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.222199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 850/1707] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:02 2022] POST /identity/v3/users => generated 286 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:03.223492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.227703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.228748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.229239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.229720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.230741 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.232674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.260689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 858/1708] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:03.264941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d95d-9a99-43b0-a0d2-ddff42e70072 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.265281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.290407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664ce82-b6e4-4333-93d1-c1c98e3f6eca admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.290992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.291751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.293120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.293405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.294170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.304185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.309537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.310968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.313669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.313669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] PATH_INFO: `/v3/projects/2effa77ab97a433fa747dd53f44c7542/users/9c3e91545d924c5591ff40650c5ede0c/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.341527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 851/1709] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:03.349440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.376682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c282-21d7-4aad-9559-5414c347b456 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.385848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.387575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.390879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.391339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.392552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.393590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2effa77ab97a433fa747dd53f44c7542, user_id=9c3e91545d924c5591ff40650c5ede0c, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.397647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.420025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed085fe-5ff2-458a-8f54-e9e244bb7d7a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.429117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 852/1710] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:03.430644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:03.453335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d116-bb46-4f6b-a3a7-7fb94b1f837f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:03.466237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:03.467831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.467831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.467831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] PATH_INFO: `/v3/projects/847c693005274d428b37d809e27cc2c9/users/5bce312f9f2747738555834e183097bc/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.522123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847c693005274d428b37d809e27cc2c9, user_id=5bce312f9f2747738555834e183097bc, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:03.534178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06c79a-2136-4e6a-bc93-88fe7aea1b58 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:03.607955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 859/1711] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:03 2022] PUT /identity/v3/projects/2effa77ab97a433fa747dd53f44c7542/users/9c3e91545d924c5591ff40650c5ede0c/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:03.619129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.619427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.619710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.697365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] MFA Rules not processed for user `9c3e91545d924c5591ff40650c5ede0c`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:03.698555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:03.773279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 853/1712] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:03 2022] PUT /identity/v3/projects/847c693005274d428b37d809e27cc2c9/users/5bce312f9f2747738555834e183097bc/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:03.778801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4cf5-e8f6-4d4d-b318-1c137af65cbd None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:03.779262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4cf5-e8f6-4d4d-b318-1c137af65cbd None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:03.779688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4cf5-e8f6-4d4d-b318-1c137af65cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:03.841500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c7fe4cf5-e8f6-4d4d-b318-1c137af65cbd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:03.841500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c7fe4cf5-e8f6-4d4d-b318-1c137af65cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:03.874263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 860/1713] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:03.878395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:04.007689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 854/1714] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:04.010361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:04.010361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:04.010361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:04.048811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] MFA Rules not processed for user `10942dbd553e44dcb49a48de4dd65d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:04.051658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:04.144984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71badef1-6dc2-49fe-aac7-5c7f679dc53d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:04.170020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:04.170774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:04.171063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:04.173459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:04.174350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:04.185291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f97c52-6b4e-42f8-b681-7beac3699d1c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:04.317569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 855/1715] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:04.323327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:04.330197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:04.339002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 861/1716] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:03 2022] POST /identity/v3/projects => generated 371 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:04.340465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:04.340807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:04.341098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:04.413818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] MFA Rules not processed for user `10942dbd553e44dcb49a48de4dd65d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:04.415139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:04.510078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:04.549805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9c7c-8efd-4980-91d1-27cc3f316c08 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:04.587904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:04.622846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 862/1717] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:04.627917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:04.690739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:04.692161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:04.692934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:04.694075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:04.801352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8053d-1551-4e45-8fb1-033998f5f2c2 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:04.812865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:04.813577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:04.813864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:04.814152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:04.814863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:04.821253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:04.950363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 863/1718] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:04 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:04.951452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:04.957857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:04.963479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:04.966801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.044162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 856/1719] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:05.045160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:05.087274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069db2b-5f7b-47de-9907-d163ab3b0dbf service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:05.154712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:05.155444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.155734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.156035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.161950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:05.161950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.214211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 857/1720] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:05.228768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:05.255280 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af561a-36f2-4f9d-9e5a-d207918524b9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:05.292336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:05.293395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.293683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.293964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] PATH_INFO: `/v3/projects/ae8baf873a004ffdaf5ad145817667a9/users/b8f8949dd52f4c928cf0bb74e322eba7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.324628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35288-bb78-4ec1-aea4-a3c707bdf8f0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:05.345546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:05.346235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.347497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8baf873a004ffdaf5ad145817667a9, user_id=b8f8949dd52f4c928cf0bb74e322eba7, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:05.351967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.352794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.354746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.380586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:05.382286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.397572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 864/1721] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:05.559339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 858/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:05 2022] PUT /identity/v3/projects/ae8baf873a004ffdaf5ad145817667a9/users/b8f8949dd52f4c928cf0bb74e322eba7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:05.563176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:05.581028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af9fc-460e-4224-a8b2-c6083bc2b655 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:05.694520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:05.695207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.695502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.695781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.696572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:05.698223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b6de-ac52-4c03-9617-0f64cb5bf963 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.714654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 865/1723] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:05.717146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:05.736504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adfe3-a52b-4832-ba07-1d5c25da29d0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:05.749156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:05.750257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.750545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.750837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] PATH_INFO: `/v3/projects/ae8baf873a004ffdaf5ad145817667a9/users/b8f8949dd52f4c928cf0bb74e322eba7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.754886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8baf873a004ffdaf5ad145817667a9, user_id=b8f8949dd52f4c928cf0bb74e322eba7, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:05.765020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:05.809969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 859/1724] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:05 2022] PUT /identity/v3/projects/ae8baf873a004ffdaf5ad145817667a9/users/b8f8949dd52f4c928cf0bb74e322eba7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:05.814646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:05.814978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:05.815300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:05.878811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] MFA Rules not processed for user `b8f8949dd52f4c928cf0bb74e322eba7`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:05.880953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:05.920968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:06.147973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 866/1725] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:06.157373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:06.159348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:06.230459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:06.369598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9bd4-1105-489e-9538-5467a733ad43 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:06.375474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:06.376725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:06.377453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:06.377453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:06.400894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:06.403860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d15d5-3d53-4de5-b5be-0e8e100e76bd service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:06.433996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 860/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:06.559729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:06.561430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:06.689918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ae1-3afd-4f67-90be-a9cf88c8e869 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:06.696785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:06.698457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:06.698975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:06.699330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] PATH_INFO: `/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:06.700878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bdc37c6a9f4453b3fc672a77c710fd)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:06.703167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:06.715731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5856b6-35b5-41fe-a5ff-879b15591fc4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:06.716153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5856b6-35b5-41fe-a5ff-879b15591fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:06.716510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5856b6-35b5-41fe-a5ff-879b15591fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:06.758018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-cf5856b6-35b5-41fe-a5ff-879b15591fc4 None None] MFA Rules not processed for user `fd48e2130723461d8d09484cb3b7a0df`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:06.759443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cf5856b6-35b5-41fe-a5ff-879b15591fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:06.883040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 861/1727] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:06.883040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5820-90a2-406b-b6a1-eb057b522dd9 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:06.883040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5820-90a2-406b-b6a1-eb057b522dd9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:06.883040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5820-90a2-406b-b6a1-eb057b522dd9 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:06.883040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 862/1728] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jun 15 14:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:54:06.885321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8960e-f3e1-4a12-a7a9-3e116e49e63c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:06.885703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8960e-f3e1-4a12-a7a9-3e116e49e63c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:06.886055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8960e-f3e1-4a12-a7a9-3e116e49e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:06.929533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bdc37c6a9f4453b3fc672a77c710fd', 'request_id': 'req-66b841c0-aa4a-4d01-96b3-28de5497bd30'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:06.939851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-57a8960e-f3e1-4a12-a7a9-3e116e49e63c None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:06.947474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-57a8960e-f3e1-4a12-a7a9-3e116e49e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:07.031365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bdc37c6a9f4453b3fc672a77c710fd', 'request_id': 'req-66b841c0-aa4a-4d01-96b3-28de5497bd30'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:07.057705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bdc37c6a9f4453b3fc672a77c710fd', 'request_id': 'req-66b841c0-aa4a-4d01-96b3-28de5497bd30'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:07.080001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 863/1729] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:07.112454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] The token cache is being invalidate because project 75bdc37c6a9f4453b3fc672a77c710fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:07.112598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:07.119578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:07.124721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 867/1730] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:06 2022] DELETE /identity/v3/projects/75bdc37c6a9f4453b3fc672a77c710fd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:07.135600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.135838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.136800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.162557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:07.164329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:07.195933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:07.197561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:07.202200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b841c0-aa4a-4d01-96b3-28de5497bd30 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:07.218958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:07.222312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.223250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.226095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.231590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:07.241673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:07.262060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:07.263837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e594c-e572-4960-bd86-dbb5b68e0086 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:07.277756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 868/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:07.357479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 864/1732] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:07.358765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.359194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.359479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.423586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:07.429989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:07.455141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 869/1733] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:07.460051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:07.476544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085443-09d8-4f87-95c7-749dcf2666f1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:07.482956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:07.485262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.485262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.485262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.494413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:07.494819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:07.498520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:07.516502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 865/1734] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:07.522705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:07.534830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56d61d-e927-4f89-a468-74c51a32a487 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:07.542764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:07.544283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.544711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.545266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.546152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:07.548123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:07.679546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:07.680093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 870/1735] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:07 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:07.690477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838a0f-2b79-4357-969e-b9ac19b60bee admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:07.760979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:07.761922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.762274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.763039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.763395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:07.765530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:07.951239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 866/1736] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:07 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:07.958051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:07.980307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d340-3932-4a8a-ad40-c89808592550 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:07.986547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:07.987507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:07.987507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:07.987789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:07.988544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:07.990756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:08.016977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 871/1737] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:08.034308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:08.057799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4370ff8-fd23-4be6-8451-f98a78171935 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:08.071314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:08.072138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.072534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.072917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.073855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:08.075968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3bd98-53d4-4e54-8072-1a1b8cebdd52 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:08.102078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 867/1738] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:08.106614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:08.119573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906c1c-2cd7-4ea5-8118-74540a2e1f3b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:08.128478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:08.129658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.131225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.131945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] PATH_INFO: `/v3/projects/6f04c4b808a94766af511ff817d4fd3d/users/52d089a448ef467aa71d80afca617145/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.160389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f04c4b808a94766af511ff817d4fd3d, user_id=52d089a448ef467aa71d80afca617145, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:08.162792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.165326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.165856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.168260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ab81-0450-4265-8a9a-42e74e7fb705 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:08.221874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] MFA Rules not processed for user `8177948cd6074d1f8240500be6bcd424`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:08.227365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:08.253860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 872/1739] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:08 2022] PUT /identity/v3/projects/6f04c4b808a94766af511ff817d4fd3d/users/52d089a448ef467aa71d80afca617145/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:08.270355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.270956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.271575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.344474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:08.354408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] MFA Rules not processed for user `52d089a448ef467aa71d80afca617145`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:08.358089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:08.421029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 868/1740] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:08.422922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:08.426556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:08.469928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce13be3-8a11-45cb-9345-a1b2303451ab None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:08.554749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 873/1741] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:08.559555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:08.630705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:08.633068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.634057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.634351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] PATH_INFO: `/v3/users/9c3e91545d924c5591ff40650c5ede0c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.638818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3e91545d924c5591ff40650c5ede0c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:08.645296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:08.646844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:08.752485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d845cc7-facb-4b67-88e3-0c345fb5334e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:08.774504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:08.775945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:08.775945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:08.776582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:08.777154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:08.779679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:08.922608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 874/1742] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:08.927779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.000733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3e91545d924c5591ff40650c5ede0c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:09.001900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3e91545d924c5591ff40650c5ede0c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:09.051404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3e91545d924c5591ff40650c5ede0c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:09.097962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd46b-8ac7-4ed1-8549-97f6e380d1a2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.108466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.109189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.109541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.109935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.110923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.113353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c9138-1a26-42d0-8d14-28c6c0d3af7c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.168446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3e91545d924c5591ff40650c5ede0c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:09.182562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-083bf5fe-6032-46cd-9d8a-2cfcee42c2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3e91545d924c5591ff40650c5ede0c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:09.206327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 869/1743] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:08 2022] DELETE /identity/v3/users/9c3e91545d924c5591ff40650c5ede0c => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:09.231521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.233430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.235415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.254457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 875/1744] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:08 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:09.254457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.254457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.257726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.280376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:09.282288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:09.316497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] MFA Rules not processed for user `5bce312f9f2747738555834e183097bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:09.317812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:09.418390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 870/1745] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:09.421021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.436701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:09.474900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebe2d4-ddfb-49cb-a419-5025ae1463b8 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.502788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.503622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.504079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.504468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.510030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 876/1746] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:09.514188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.515349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:09.520349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.522892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.559872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 871/1747] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:09.564864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.573174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:09.616216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91b2d-acce-4742-bbd9-905af3d39d6b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.629758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.631778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.632090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.632247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.634370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.637288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.652269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:09.658658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddad2-2572-4a79-9e13-fbf83a23da17 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.667104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.667783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.668093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.668373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.681489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.686270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.698548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 877/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:09.698757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.710389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6caa2-6323-479d-88a9-cc4d450b5a21 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.716287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.717069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.717361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.717701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.718361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.720145 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.735506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 878/1749] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:09.741329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.757141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382ec0d-3732-4f60-bfe1-4114231eaddd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:09.763932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:09.765103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.765502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.765929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] PATH_INFO: `/v3/projects/5ac953c9ac2f40e68be613b03f2db272/users/4053085159d843df8ee8d77d38ee6a49/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.788918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac953c9ac2f40e68be613b03f2db272, user_id=4053085159d843df8ee8d77d38ee6a49, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:09.797836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f027ed-79cf-4ff6-b098-bf6092047761 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:09.844038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 872/1750] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:09 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:09.848140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:09.952689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 879/1751] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:09 2022] PUT /identity/v3/projects/5ac953c9ac2f40e68be613b03f2db272/users/4053085159d843df8ee8d77d38ee6a49/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:09.955102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc169-3f99-403c-b108-3e109c653691 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:09.955398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc169-3f99-403c-b108-3e109c653691 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:09.957069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc169-3f99-403c-b108-3e109c653691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:09.990661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb73f-67dc-425f-b85f-81ebaef93fd7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.001839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-796bc169-3f99-403c-b108-3e109c653691 None None] MFA Rules not processed for user `10942dbd553e44dcb49a48de4dd65d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:10.003296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-796bc169-3f99-403c-b108-3e109c653691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:10.066172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.066861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.067145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.067425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.069047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.071662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.135440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 880/1752] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:10.136870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.137161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.137437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.191150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 873/1753] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:09 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:10.193696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] MFA Rules not processed for user `4053085159d843df8ee8d77d38ee6a49`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:10.195126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.196295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:10.208066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7835-fc6c-46fa-82e7-686b1c213209 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.214556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.216597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.217291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.222132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.224805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.230843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.247615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 874/1754] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:10.250740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.262096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2f6c-7b2e-46bf-8377-61652389d508 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.267344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.268295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.268580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.268896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] PATH_INFO: `/v3/projects/2efb2b9bad814778aa430ec2d8bee984/users/c06ce9be336f409f911d5073a77ffe71/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.309978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 881/1755] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:10.315554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.321272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efb2b9bad814778aa430ec2d8bee984, user_id=c06ce9be336f409f911d5073a77ffe71, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.326599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.354681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633af6c-95d7-450f-9aff-ce245061ba51 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.370176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.370539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.371092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.371503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.372412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.378336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.453884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 875/1756] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:10 2022] PUT /identity/v3/projects/2efb2b9bad814778aa430ec2d8bee984/users/c06ce9be336f409f911d5073a77ffe71/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:10.460591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.508996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 882/1757] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:10 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:10.513023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.559257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b287e-67dd-4b1d-b5da-b9a3b02ceec6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.633866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0a4b8-a014-48f3-ab10-b198407c576e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.641278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.642096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.642890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.643285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.644189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.647235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.697873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.698561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.698851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.699143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.699894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.701523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.722296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 876/1758] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:10.728060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.737575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 883/1759] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:10 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:10.744254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.751792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0c54-8117-4ce9-b698-d7e9e9c6421b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.763833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.764691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.764976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.765324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] PATH_INFO: `/v3/projects/2efb2b9bad814778aa430ec2d8bee984/users/c06ce9be336f409f911d5073a77ffe71/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.767110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2dca-c728-40b8-8254-ec3a99d634cf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.771851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efb2b9bad814778aa430ec2d8bee984, user_id=c06ce9be336f409f911d5073a77ffe71, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.775585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.778450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.779472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.779894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.780266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.781213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.783272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:10.801507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 884/1760] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:10.804067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:10.808039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 877/1761] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:10 2022] PUT /identity/v3/projects/2efb2b9bad814778aa430ec2d8bee984/users/c06ce9be336f409f911d5073a77ffe71/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:10.820216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e694-1799-4d0a-8019-edce17ab5d9f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:10.912460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:10.914053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:10.914255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:10.914549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] PATH_INFO: `/v3/projects/855511a04e9f4eef803a3429879eb2e9/users/bc35092d4e6840a4ba2376611e8555a3/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:10.938075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855511a04e9f4eef803a3429879eb2e9, user_id=bc35092d4e6840a4ba2376611e8555a3, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:10.947340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:11.000814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:11.002681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:11.075425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 885/1762] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:10 2022] PUT /identity/v3/projects/855511a04e9f4eef803a3429879eb2e9/users/bc35092d4e6840a4ba2376611e8555a3/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:11.075425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:11.082279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da8ac-f20e-4811-9191-b74cb2502d59 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:11.321198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249aa5e-f0bf-4439-b861-7c5e7ceef746 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:11.331757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:11.336688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:11.336688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:11.336688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:11.337343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:11.341621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:11.344114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:11.346590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:11.348043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:11.348783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] PATH_INFO: `/v3/projects/2effa77ab97a433fa747dd53f44c7542` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:11.357417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2effa77ab97a433fa747dd53f44c7542)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:11.371518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:11.373100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 886/1763] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:11.374043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:11.421653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3fab1-47ff-4b00-83fb-0c4880bbe4d2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:11.433454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:11.438754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:11.440299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:11.440591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] PATH_INFO: `/v3/projects/855511a04e9f4eef803a3429879eb2e9/users/bc35092d4e6840a4ba2376611e8555a3/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:11.447100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855511a04e9f4eef803a3429879eb2e9, user_id=bc35092d4e6840a4ba2376611e8555a3, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:11.462718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c8c2-801c-499f-bd3d-9d8b45e14eb4 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:11.504016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 887/1764] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:11 2022] PUT /identity/v3/projects/855511a04e9f4eef803a3429879eb2e9/users/bc35092d4e6840a4ba2376611e8555a3/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:11.514679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:11.515283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:11.515695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:11.647977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2effa77ab97a433fa747dd53f44c7542', 'request_id': 'req-799cb3c5-31fe-42b4-892c-00b2364d811a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:11.671305 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] MFA Rules not processed for user `bc35092d4e6840a4ba2376611e8555a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:11.675456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:11.818671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 888/1765] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:11.835657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:11.838591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:11.853236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2effa77ab97a433fa747dd53f44c7542', 'request_id': 'req-799cb3c5-31fe-42b4-892c-00b2364d811a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:11.868627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2effa77ab97a433fa747dd53f44c7542', 'request_id': 'req-799cb3c5-31fe-42b4-892c-00b2364d811a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:11.882225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] The token cache is being invalidate because project 2effa77ab97a433fa747dd53f44c7542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:11.882519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:11.883195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:11.884830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 878/1766] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:10 2022] DELETE /identity/v3/projects/2effa77ab97a433fa747dd53f44c7542 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:11.908208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:11.914688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:12.039706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88839-2aa4-4af8-860e-9ca275030a55 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:12.054819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:12.055279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:12.055571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:12.055888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:12.063900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:12.092864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:12.094361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:12.148074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 889/1767] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:12.205613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb3c5-31fe-42b4-892c-00b2364d811a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:12.214441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:12.216239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:12.216623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:12.217363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] PATH_INFO: `/v3/users/b8f8949dd52f4c928cf0bb74e322eba7` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:12.220740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f8949dd52f4c928cf0bb74e322eba7)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:12.227288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:12.292387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:12.617785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f8949dd52f4c928cf0bb74e322eba7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:12.618704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f8949dd52f4c928cf0bb74e322eba7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:12.636148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f8949dd52f4c928cf0bb74e322eba7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:12.745449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f8949dd52f4c928cf0bb74e322eba7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:12.759031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-174e1d30-6d3e-46a0-82c0-6a917ef4a481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f8949dd52f4c928cf0bb74e322eba7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:12.785438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 879/1768] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:11 2022] DELETE /identity/v3/users/b8f8949dd52f4c928cf0bb74e322eba7 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:14.783897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:14.827390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa21e7-da14-4fac-8e99-aca928fde3ce service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:14.931857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6d4b-ff22-4e5b-b2f4-4d64f4af5a12 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:14.932327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6d4b-ff22-4e5b-b2f4-4d64f4af5a12 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:14.932498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6d4b-ff22-4e5b-b2f4-4d64f4af5a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:14.975085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:15.000902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-530a6d4b-ff22-4e5b-b2f4-4d64f4af5a12 None None] MFA Rules not processed for user `c06ce9be336f409f911d5073a77ffe71`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:15.002182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-530a6d4b-ff22-4e5b-b2f4-4d64f4af5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.138101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:15.138790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.146006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.146006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] PATH_INFO: `/v3/projects/ae8baf873a004ffdaf5ad145817667a9` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.146006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8baf873a004ffdaf5ad145817667a9)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:15.148428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:15.231540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 880/1769] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:15.247532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.247532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.247532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.316488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] MFA Rules not processed for user `5bce312f9f2747738555834e183097bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:15.317742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.356334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8baf873a004ffdaf5ad145817667a9', 'request_id': 'req-a974de3c-fd3f-409c-bed2-92f31abfb741'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:15.469882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8baf873a004ffdaf5ad145817667a9', 'request_id': 'req-a974de3c-fd3f-409c-bed2-92f31abfb741'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:15.481465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8baf873a004ffdaf5ad145817667a9', 'request_id': 'req-a974de3c-fd3f-409c-bed2-92f31abfb741'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:15.490006 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 881/1770] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:15.491391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:15.493027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.517413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] The token cache is being invalidate because project ae8baf873a004ffdaf5ad145817667a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:15.517711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:15.518423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:15.527259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 890/1771] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:14 2022] DELETE /identity/v3/projects/ae8baf873a004ffdaf5ad145817667a9 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:15.528264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:15.531230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.598974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c1a0-ed6f-430f-a6e9-a137b8b76a05 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:15.688705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974de3c-fd3f-409c-bed2-92f31abfb741 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:15.692995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:15.694708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.695244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.695858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.696968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:15.697711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.698068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.698417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.698917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.701097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.790469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:15.792525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070e33-f476-4d5c-b986-f80b0122f5eb service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:15.795376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:15.798281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27b7b-74ab-4c3b-bf45-3672959667c5 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:15.804853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 882/1772] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:15.806380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbfb9-e125-419f-8bbd-f9b881bf9740 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.806684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbfb9-e125-419f-8bbd-f9b881bf9740 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.806952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbfb9-e125-419f-8bbd-f9b881bf9740 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.808871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 883/1773] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:54:15.809575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 891/1774] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:15.810175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.810460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.810733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.827180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620f85-91ff-4a97-b7b8-354b0f6dbf99 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.827468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620f85-91ff-4a97-b7b8-354b0f6dbf99 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.827750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620f85-91ff-4a97-b7b8-354b0f6dbf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:15.835162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:15.836693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.867377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-75620f85-91ff-4a97-b7b8-354b0f6dbf99 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:15.867681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-75620f85-91ff-4a97-b7b8-354b0f6dbf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:15.913300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 892/1775] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:15.969470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 884/1776] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:15.979718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:15.980094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:15.980381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.003123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:16.010538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:16.013531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 893/1777] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:16.018725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.031671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf6be-5000-40cb-a458-03b5e6345428 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.040111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.042127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:16.058958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.059841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.060484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a81c-96f5-4bce-9ac5-fea719f0729e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.060948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.061246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.062385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:16.062708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.064345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.067509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.068215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.068621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.068990 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.082582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.084706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.086781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 885/1778] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:16.091201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.098906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 894/1779] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:16.103497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473955dc-f973-4cde-a4a8-c6719c352c99 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.109198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.110315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.110604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.110879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.111582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.113592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.235215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 886/1780] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:16 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:16.239095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.260263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded9e79-e8ba-43d3-b104-19c61967cc80 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.399756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.400616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.401705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.402059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.402824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.406024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.582995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 895/1781] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:16 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:16.588353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.614807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa201-2a9d-4b87-b20c-efcb4edef3aa admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.621835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.623121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.633661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.633661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.633661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.637421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.668358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 887/1782] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:16.669473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.692618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:16.706400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7dafa-2877-456c-93ed-ea94553747d1 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.760916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.761615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.761901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.762176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.762926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.775457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cdbf0-0315-4ed2-b65e-d26680320a8f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:16.827854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 896/1783] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:16.829291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:16.845363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03a95e-9d06-45d0-82f9-b293e4b247b4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:16.852679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:16.856475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:16.858540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:16.859013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] PATH_INFO: `/v3/projects/f7e625181c4d4a03a872dbd45d754a43/users/af3f4938df5d45a0894fd4a721a5ca5d/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:16.898744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e625181c4d4a03a872dbd45d754a43, user_id=af3f4938df5d45a0894fd4a721a5ca5d, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:16.901946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:17.117252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 888/1784] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:16 2022] PUT /identity/v3/projects/f7e625181c4d4a03a872dbd45d754a43/users/af3f4938df5d45a0894fd4a721a5ca5d/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:17.129084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:17.129469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:17.129881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:17.159970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] MFA Rules not processed for user `af3f4938df5d45a0894fd4a721a5ca5d`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:17.171748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:17.387103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 897/1785] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:17.391614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:17.505725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5279-fcaf-4419-8902-471699ea7a71 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:17.517443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:17.518364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:17.518790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:17.519240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:17.520291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:17.523409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:17.675080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 889/1786] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:17 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:17.680033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:17.695282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ac1d-f9dd-4d5b-bdec-7b0194741cda None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:17.826744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:17.827535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:17.827918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:17.828465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:17.829236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:17.832075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.005804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 898/1787] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:17 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:18.009682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:18.021242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d3e8-4160-4799-916e-62805da93e59 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:18.026782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:18.031614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.031954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.032207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.033092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:18.034773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.065694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 890/1788] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:18.070234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:18.098328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304785-ad6c-49b0-8ae2-5cf0f6010298 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:18.107047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:18.108713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.109241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.109899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] PATH_INFO: `/v3/projects/94e5dc1524874423b0734b516b0eb20a/users/9be55b433b83422b98e75d32e30f9f3f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.144994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e5dc1524874423b0734b516b0eb20a, user_id=9be55b433b83422b98e75d32e30f9f3f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:18.149820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.278097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 899/1789] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:18 2022] PUT /identity/v3/projects/94e5dc1524874423b0734b516b0eb20a/users/9be55b433b83422b98e75d32e30f9f3f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:18.282113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:18.297897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d975-76c2-43cd-843a-a1f4178bee5e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:18.434936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:18.435949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.436568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.437250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.438138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:18.440384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926f832-a7e4-41fd-b414-60912c04de72 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.457459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 891/1790] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:18.458471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:18.470617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc132-143f-4eaa-8572-9322ce8f2dfa admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:18.482495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:18.483778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.484370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.484881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] PATH_INFO: `/v3/projects/94e5dc1524874423b0734b516b0eb20a/users/9be55b433b83422b98e75d32e30f9f3f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.487395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e5dc1524874423b0734b516b0eb20a, user_id=9be55b433b83422b98e75d32e30f9f3f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:18.492137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.516149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 900/1791] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:18 2022] PUT /identity/v3/projects/94e5dc1524874423b0734b516b0eb20a/users/9be55b433b83422b98e75d32e30f9f3f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:18.517249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd5e0-3439-4f37-a217-847d45d642b2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.517540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd5e0-3439-4f37-a217-847d45d642b2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.517984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd5e0-3439-4f37-a217-847d45d642b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.592830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9f1bd5e0-3439-4f37-a217-847d45d642b2 None None] MFA Rules not processed for user `9be55b433b83422b98e75d32e30f9f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:18.594447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9f1bd5e0-3439-4f37-a217-847d45d642b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:18.713515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 892/1792] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:18.730494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:18.733075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:18.824403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe304bf-7d66-477e-9863-922d285b97af admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:18.830035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:18.830723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:18.831008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:18.831285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:18.917172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:18.919608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194bc55-fa4d-404d-8b2b-bfe6b2aec194 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:18.930511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 901/1793] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:18.983168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:19.453736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfea-b9cf-48ca-b4d9-59ef05910c5d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:19.453736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfea-b9cf-48ca-b4d9-59ef05910c5d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:19.453736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfea-b9cf-48ca-b4d9-59ef05910c5d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:19.453736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 893/1794] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:54:19.456827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:19.457117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:19.457615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:19.483416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:19.489771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:19.659428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:19.711138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 902/1795] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:19.900956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dfea-b9cf-48ca-b4d9-59ef05910c5d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:19.928585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dfea-b9cf-48ca-b4d9-59ef05910c5d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:19.939100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:19.940636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:19.941129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:19.941643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:19.953877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:19.956299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:19.971687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 894/1796] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:21.853849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:22.305754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:22.380706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:22.390335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a10b-4e93-4bad-86e5-624e13b881fd None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:22.397601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:22.398930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:22.399442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:22.399903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:22.402252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:22.508412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:22.510213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:22.521304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 903/1797] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:25.107407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:25.108939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:25.128903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0357-f3c1-4b23-8121-b14e54e6deb0 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:25.133206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:25.133938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:25.134214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:25.134655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:25.148235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:25.148235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412153-2950-4173-ac37-10b06c6d70d2 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:25.160728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 895/1798] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:25.221065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:25.768257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:28.085131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:28.086742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:28.290579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d53da-645c-43b1-ab07-8b4baf96d4fc service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:28.309014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:28.312470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:28.314266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:28.314805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] PATH_INFO: `/v3/users/52d089a448ef467aa71d80afca617145` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:28.318832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d089a448ef467aa71d80afca617145)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:28.322736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:28.693383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d089a448ef467aa71d80afca617145'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:28.709341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d089a448ef467aa71d80afca617145'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:28.710143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d089a448ef467aa71d80afca617145'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:28.737316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d089a448ef467aa71d80afca617145'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:28.738165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d089a448ef467aa71d80afca617145'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:28.866034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 904/1799] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:28 2022] DELETE /identity/v3/users/52d089a448ef467aa71d80afca617145 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:28.870939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:28.871613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:28.871613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:28.891647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:28.893085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:28.970699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 896/1800] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:28.985348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:28.985348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:29.110687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d3f0a-6232-4fcf-a839-23498937fe70 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:29.124299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:29.125049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:29.125476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:29.125753 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:29.137844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:29.139308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:29.152300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 905/1801] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:29.411580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:29.665793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:29.875556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:29.878010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:29.891146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9616-0933-4c5e-b3eb-7fc7a5979815 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:29.896811 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:29.897803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:29.898148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:29.898499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] PATH_INFO: `/v3/projects/6f04c4b808a94766af511ff817d4fd3d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:29.899936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f04c4b808a94766af511ff817d4fd3d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:29.902025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:30.017929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f04c4b808a94766af511ff817d4fd3d', 'request_id': 'req-9b09c367-b1a8-44da-9bcc-b589f8ad3007'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.128553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f04c4b808a94766af511ff817d4fd3d', 'request_id': 'req-9b09c367-b1a8-44da-9bcc-b589f8ad3007'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.136125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f04c4b808a94766af511ff817d4fd3d', 'request_id': 'req-9b09c367-b1a8-44da-9bcc-b589f8ad3007'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.148871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] The token cache is being invalidate because project 6f04c4b808a94766af511ff817d4fd3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:30.149469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.150190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.151965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 897/1802] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:29 2022] DELETE /identity/v3/projects/6f04c4b808a94766af511ff817d4fd3d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:30.156750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:30.175087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67b2a-a220-4343-b3b0-b1cd9aa77e2b service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:30.296685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:30.297672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:30.297961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:30.298231 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] PATH_INFO: `/v3/users/4053085159d843df8ee8d77d38ee6a49` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:30.300020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4053085159d843df8ee8d77d38ee6a49)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:30.302881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:30.617710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4053085159d843df8ee8d77d38ee6a49'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.625729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4053085159d843df8ee8d77d38ee6a49'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.626788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4053085159d843df8ee8d77d38ee6a49'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.641303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4053085159d843df8ee8d77d38ee6a49'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.642555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4053085159d843df8ee8d77d38ee6a49'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:30.765253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 906/1803] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:30 2022] DELETE /identity/v3/users/4053085159d843df8ee8d77d38ee6a49 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:31.607303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:31.609809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:31.629661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c367-b1a8-44da-9bcc-b589f8ad3007 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:31.746330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:31.747795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:31.748462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:31.748923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] PATH_INFO: `/v3/projects/5ac953c9ac2f40e68be613b03f2db272` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:31.752693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac953c9ac2f40e68be613b03f2db272)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:31.753064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:31.929842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac953c9ac2f40e68be613b03f2db272', 'request_id': 'req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.142987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac953c9ac2f40e68be613b03f2db272', 'request_id': 'req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.151757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac953c9ac2f40e68be613b03f2db272', 'request_id': 'req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.166861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] The token cache is being invalidate because project 5ac953c9ac2f40e68be613b03f2db272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:32.167146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.171302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.176112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 898/1804] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:31 2022] DELETE /identity/v3/projects/5ac953c9ac2f40e68be613b03f2db272 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:32.179863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:32.181997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:32.201246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38106-18a0-4c0c-8e78-2ad7e2754dfe admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:32.303050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:32.304273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:32.304560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:32.304896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] PATH_INFO: `/v3/users/bc35092d4e6840a4ba2376611e8555a3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:32.306250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc35092d4e6840a4ba2376611e8555a3)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:32.310603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:32.684913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc35092d4e6840a4ba2376611e8555a3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.698251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc35092d4e6840a4ba2376611e8555a3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.709780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:32.710558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc35092d4e6840a4ba2376611e8555a3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.712805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:32.730887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc8ab2-a50a-44ec-880d-ec4b49052bfc admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:32.744542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc35092d4e6840a4ba2376611e8555a3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.745214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:32.746323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-687c4653-163e-4bda-99b4-a551fe2dd501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc35092d4e6840a4ba2376611e8555a3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:32.746486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:32.746793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:32.747316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] PATH_INFO: `/v3/users/af3f4938df5d45a0894fd4a721a5ca5d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:32.749152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3f4938df5d45a0894fd4a721a5ca5d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:32.751538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:32.789196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:32.893646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 907/1805] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:32 2022] DELETE /identity/v3/users/bc35092d4e6840a4ba2376611e8555a3 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:33.091109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3f4938df5d45a0894fd4a721a5ca5d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.093663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3f4938df5d45a0894fd4a721a5ca5d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.120077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3f4938df5d45a0894fd4a721a5ca5d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.137161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:33.207990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3f4938df5d45a0894fd4a721a5ca5d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.222264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3f4938df5d45a0894fd4a721a5ca5d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.234490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 899/1806] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:32 2022] DELETE /identity/v3/users/af3f4938df5d45a0894fd4a721a5ca5d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:33.239595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:33.239595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:33.240431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:33.276190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:33.277806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:33.399616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 908/1807] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:33.426057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:33.429514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:33.512197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f282-ae0f-4de5-a3ff-4e430248e44f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:33.516474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:33.517254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:33.517544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:33.517820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:33.534410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:33.538342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc4af3-bbec-4b5c-b020-763f3968baeb service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:33.548025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 900/1808] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:33.677018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:33.679433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:33.701719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7ba29-3707-49f4-a8e9-2db401acbd26 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:33.712041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:33.713086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:33.713370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:33.713814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] PATH_INFO: `/v3/projects/855511a04e9f4eef803a3429879eb2e9` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:33.716274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855511a04e9f4eef803a3429879eb2e9)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:33.719059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:33.884499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855511a04e9f4eef803a3429879eb2e9', 'request_id': 'req-154fcd57-1d21-47ae-b544-de98accf3103'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.963493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855511a04e9f4eef803a3429879eb2e9', 'request_id': 'req-154fcd57-1d21-47ae-b544-de98accf3103'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.972867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855511a04e9f4eef803a3429879eb2e9', 'request_id': 'req-154fcd57-1d21-47ae-b544-de98accf3103'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.991029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] The token cache is being invalidate because project 855511a04e9f4eef803a3429879eb2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:33.991580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:33.993134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-154fcd57-1d21-47ae-b544-de98accf3103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.002011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.002872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.003415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.006377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 909/1809] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:33 2022] DELETE /identity/v3/projects/855511a04e9f4eef803a3429879eb2e9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:34.075083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:34.082050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:34.314590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 901/1810] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:34.325072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.325963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.325963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.350350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:34.350350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:34.351434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.353009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:34.361918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 910/1811] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:34.366002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.378872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5bc46-e7e4-4e0e-8b62-af18f3c003ee None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.382406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d70e-7d5d-4266-91ac-0d055ef1fd15 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.384934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.385855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.386197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.386531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] PATH_INFO: `/v3/projects/f7e625181c4d4a03a872dbd45d754a43` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.387947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e625181c4d4a03a872dbd45d754a43)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.390124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.391059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.392369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.392885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.393297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.395075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:34.398302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.405758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.421382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 911/1812] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:54:34.424569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.438258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0711-bd70-4a48-93dd-079d627cc6c0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.445250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.446295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.446603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.446848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.447575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.449724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.548587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e625181c4d4a03a872dbd45d754a43', 'request_id': 'req-09023715-172b-425b-817f-01401baf9c4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.566154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 912/1813] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:34 2022] POST /identity/v3/projects => generated 397 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:34.570649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.607435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e625181c4d4a03a872dbd45d754a43', 'request_id': 'req-09023715-172b-425b-817f-01401baf9c4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.619360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e625181c4d4a03a872dbd45d754a43', 'request_id': 'req-09023715-172b-425b-817f-01401baf9c4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.636371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] The token cache is being invalidate because project f7e625181c4d4a03a872dbd45d754a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:34.637695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.639235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.642429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 902/1814] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:34 2022] DELETE /identity/v3/projects/f7e625181c4d4a03a872dbd45d754a43 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:34.648886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.650312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:34.656638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ba7-921d-432d-8757-2c22ec40881b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.663685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.664287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.664572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.664847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.665802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.667776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.745055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09023715-172b-425b-817f-01401baf9c4e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.747695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.748676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.748930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.749201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] PATH_INFO: `/v3/users/9be55b433b83422b98e75d32e30f9f3f` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.750621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be55b433b83422b98e75d32e30f9f3f)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.752572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.772495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 913/1815] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:34 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:34.776626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.779168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:34.793604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae735d3-23a3-4299-91ba-145dc70599df admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.798276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.798940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.799233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.799495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.800273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.801855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.812774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 914/1816] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:34.816682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.826875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68702897-7a1d-47b2-8e62-0a65a0be33c9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.831726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.832433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.832818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.832976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.834689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.836348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.847643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 915/1817] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:34.852886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:34.863190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5acc-c0d1-42ef-802e-49f352c81211 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:34.867996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:34.869062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:34.869173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:34.869437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] PATH_INFO: `/v3/projects/80f47260b5da4e82b661ae4a287c7011/users/41a63995982745feaa3514409a6b5447/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:34.885686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f47260b5da4e82b661ae4a287c7011, user_id=41a63995982745feaa3514409a6b5447, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:34.888486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe86c4-e0f1-4599-8ef8-6187086a5045 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:34.992361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be55b433b83422b98e75d32e30f9f3f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:34.993498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be55b433b83422b98e75d32e30f9f3f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:35.003271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 916/1818] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:34 2022] PUT /identity/v3/projects/80f47260b5da4e82b661ae4a287c7011/users/41a63995982745feaa3514409a6b5447/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:35.008110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be55b433b83422b98e75d32e30f9f3f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:35.015316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.015610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.015931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.049697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] MFA Rules not processed for user `41a63995982745feaa3514409a6b5447`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:35.050922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:35.088692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be55b433b83422b98e75d32e30f9f3f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:35.097379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be55b433b83422b98e75d32e30f9f3f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:35.106560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 903/1819] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:34 2022] DELETE /identity/v3/users/9be55b433b83422b98e75d32e30f9f3f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:35.165655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 917/1820] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:35.171455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.172938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:35.293689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48ae5-20a1-4728-8b8b-ec01b4fd2ea9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:35.299403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:35.300197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.300480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.300754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.303023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:35.305329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:35.395250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:35.439015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 904/1821] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:35 2022] POST /identity/v3/projects => generated 401 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:35.442772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.533460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777b819-b38b-4d6f-85d8-6ce989a6047f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:35.592094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:35.592769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.593047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.593319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.594054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:35.596005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:35.667732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.669984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:35.685241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728683-2cd7-4a9f-b7f2-d15d0fa0ff39 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:35.691623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:35.692641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.692933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.693752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] PATH_INFO: `/v3/projects/94e5dc1524874423b0734b516b0eb20a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.695376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e5dc1524874423b0734b516b0eb20a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:35.697459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:35.707315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 918/1822] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:35 2022] POST /identity/v3/users => generated 307 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:35.711629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.723039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4170aac-53ac-4518-b319-490b577c011f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:35.734772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:35.735650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.736038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.736387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.739477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:35.742469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:35.753462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 919/1823] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:35.767358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.778932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a56bc-2713-4625-9e5b-010ad1341895 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:35.784239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:35.789481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:35.789481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:35.789481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] PATH_INFO: `/v3/projects/3b51f99c18db412ea2f7e90b15f51964/users/b98130e815054b67a6c1eb6a5faaad63/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:35.819900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:35.821844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b51f99c18db412ea2f7e90b15f51964, user_id=b98130e815054b67a6c1eb6a5faaad63, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:35.824571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:35.936951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 920/1824] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:35 2022] PUT /identity/v3/projects/3b51f99c18db412ea2f7e90b15f51964/users/b98130e815054b67a6c1eb6a5faaad63/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:35.940131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:35.950292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e5dc1524874423b0734b516b0eb20a', 'request_id': 'req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:36.015982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b51c-5029-4a64-9aa5-3686c65de219 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.039638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e5dc1524874423b0734b516b0eb20a', 'request_id': 'req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:36.047995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e5dc1524874423b0734b516b0eb20a', 'request_id': 'req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:36.064931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] The token cache is being invalidate because project 94e5dc1524874423b0734b516b0eb20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:36.065608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:36.066838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ef3c8f80-078c-4dde-b69e-6ca9b1efa5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:36.069399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 905/1825] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:35 2022] DELETE /identity/v3/projects/94e5dc1524874423b0734b516b0eb20a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:36.076713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d47d8-152f-43fd-8f02-18d9cd81f52f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.077351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d47d8-152f-43fd-8f02-18d9cd81f52f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.078022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d47d8-152f-43fd-8f02-18d9cd81f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.092505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.093791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.094341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.094997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.096058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.098182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.107423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-977d47d8-152f-43fd-8f02-18d9cd81f52f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:36.109208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-977d47d8-152f-43fd-8f02-18d9cd81f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.112961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 921/1826] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:36.118085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.119986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 906/1827] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:36.129089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.140841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.141008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.141111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.150827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ec4c-630b-4861-b0d7-f61447a91011 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.156448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.157373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.157647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.158518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] PATH_INFO: `/v3/projects/3b51f99c18db412ea2f7e90b15f51964/users/b98130e815054b67a6c1eb6a5faaad63/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.160658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b51f99c18db412ea2f7e90b15f51964, user_id=b98130e815054b67a6c1eb6a5faaad63, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.162788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:36.164300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35b5e3-f376-4180-9a76-460dc02cad11 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.165779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.179250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 907/1829] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:36.179882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 922/1829] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:36 2022] PUT /identity/v3/projects/3b51f99c18db412ea2f7e90b15f51964/users/b98130e815054b67a6c1eb6a5faaad63/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:36.183222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.189412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.193637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.193637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.199197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577d97c-8b1f-4ffd-b3c0-3533fbbddfa2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.232641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] MFA Rules not processed for user `b98130e815054b67a6c1eb6a5faaad63`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:36.234223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.272863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.273926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.274573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.275121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.276174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:36.276694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.278863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.294392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 908/1830] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:54:36.300469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.313792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282bd92-5149-4d88-b81b-19174140b9fa admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.319480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.321505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.321798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.322081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.322797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.324832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 923/1831] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:36.328969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.338034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.341525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.426819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72bef-529a-4ead-a0fe-47c92bb2c05b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.432283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.433065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.433415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.434594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.447835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.451352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.458800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 909/1832] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:36 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:36.462744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.478254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 924/1833] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:36.548620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275b73-f85d-446f-b28a-f15503387d9c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.555590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.556457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.556911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.557215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.558005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.562127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.701362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 910/1834] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:36 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:36.707318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.720970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f928dd-e1bf-4974-ba06-52ba14d139b8 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.748813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.749498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.749884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.750171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.750907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.752864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.753780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.769303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 925/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:36.770400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.782732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c268c-8589-4b18-a794-47c6bc428b68 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.812048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.812820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.813032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.813313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.814051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.815690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.825819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394e6e1-9d51-4ec9-8f20-efa277317b7b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.829279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 926/1836] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:36.833146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.833666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:36.834840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.835299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.835736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.842810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:36.844612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a2759-da37-42b1-9d78-e3aa0941261d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:36.851374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:36.852320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:36.852605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:36.853160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] PATH_INFO: `/v3/projects/a612abc356cd4923b03a4890f1b7aabe/users/60b7b331350f4724afe94fa8ba858f8c/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:36.871306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a612abc356cd4923b03a4890f1b7aabe, user_id=60b7b331350f4724afe94fa8ba858f8c, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.874732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.916776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:36.918241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db733-83a6-441b-8182-f72cb18dbff7 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:36.929628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 911/1837] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:36.994926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 927/1838] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:36 2022] PUT /identity/v3/projects/a612abc356cd4923b03a4890f1b7aabe/users/60b7b331350f4724afe94fa8ba858f8c/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:37.012502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:37.020248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:37.020248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:37.055598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] MFA Rules not processed for user `60b7b331350f4724afe94fa8ba858f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:37.058789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:37.167845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 912/1839] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:37.180073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:37.182593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:37.292688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:37.305643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f520-b176-4edf-977a-b23b76aeeedd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:37.316127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:37.320094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:37.320735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:37.321585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:37.341769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:37.345558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124ec8-ba95-4a7c-8aa0-a926f323989e service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:37.368238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 928/1840] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:37.400429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:37.505098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a614-7333-4147-aa5a-c6e03c3a9dc6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:37.516340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:37.517645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:37.517932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:37.518208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] PATH_INFO: `/v3/users/60b7b331350f4724afe94fa8ba858f8c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:37.519601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b7b331350f4724afe94fa8ba858f8c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:37.522702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:37.803990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b7b331350f4724afe94fa8ba858f8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:37.805578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b7b331350f4724afe94fa8ba858f8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:37.831653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b7b331350f4724afe94fa8ba858f8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:37.927045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b7b331350f4724afe94fa8ba858f8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:37.936242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b7b331350f4724afe94fa8ba858f8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:37.944901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 913/1841] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:37 2022] DELETE /identity/v3/users/60b7b331350f4724afe94fa8ba858f8c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:37.949504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:37.949985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:37.950066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:37.984082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:37.989673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:38.104345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 929/1842] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:38.114341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:38.116745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:38.196974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9c107-d3ec-404f-a121-9bb7c0b9083e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:38.201298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:38.202019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:38.202307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:38.202588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:38.217554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:38.219401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bdf60-ec9b-4157-98ba-b59670a24763 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:38.231217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 914/1843] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:38.657058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:38.834974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:38.837662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:38.853696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108885ac-b7b9-48ce-bbe0-5bd6ee8982a3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:38.862559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:38.865352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:38.865352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:38.865352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] PATH_INFO: `/v3/projects/a612abc356cd4923b03a4890f1b7aabe` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:38.866808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a612abc356cd4923b03a4890f1b7aabe)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:38.869295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.026380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a612abc356cd4923b03a4890f1b7aabe', 'request_id': 'req-210d1bb7-3af6-4399-8188-312cf321cd86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:39.144639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a612abc356cd4923b03a4890f1b7aabe', 'request_id': 'req-210d1bb7-3af6-4399-8188-312cf321cd86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:39.157007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a612abc356cd4923b03a4890f1b7aabe', 'request_id': 'req-210d1bb7-3af6-4399-8188-312cf321cd86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:39.175093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] The token cache is being invalidate because project a612abc356cd4923b03a4890f1b7aabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:39.175385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:39.176090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-210d1bb7-3af6-4399-8188-312cf321cd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:39.177791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 930/1844] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:38 2022] DELETE /identity/v3/projects/a612abc356cd4923b03a4890f1b7aabe => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:39.182820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.183271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.183380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.203582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:39.210157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:39.297067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 915/1845] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:39.302722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.302959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.305038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.326253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:39.327610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:39.337507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 931/1846] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:39.343243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.357819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf10dd-4d01-4f6c-b5de-172ab2225d5f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.365803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.366604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.366974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.367301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.368222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:39.368602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.370398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.399465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 916/1847] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:39.399697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.411513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40205c-6fe0-4f27-a849-914016b56aec None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.424296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.424296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.424296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.424296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.430079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.430079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.543257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 932/1848] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:39 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:39.549860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.563868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac3ce-1699-41a3-9146-4d74da99f88b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.633403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.634615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.635035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.635951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.636741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.639584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.785205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 917/1849] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:39 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:39.790193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.804117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd3c0a-496a-4bcc-b23d-f7ecd2e3a7b5 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.809785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.810494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.810780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.811064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.812112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.813744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.827425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 933/1850] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:39.831618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.843523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051602d-df95-4cc3-b08b-c9b41c412705 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.849197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.849985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.850265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.850539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.851357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.853064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a58ed-2bd6-4808-99fd-470e5e5a2c3d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:39.867072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 918/1851] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:39.871696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:39.883209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c61cd-5d9e-46db-8d08-9bb5f28677eb admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:39.887947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:39.888842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:39.889122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:39.889396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] PATH_INFO: `/v3/projects/9b9ac74d2a624f95a19e70c0c1c7f1cf/users/56de23f2f8ed4f62a4760f1b035f402d/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:39.904864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9ac74d2a624f95a19e70c0c1c7f1cf, user_id=56de23f2f8ed4f62a4760f1b035f402d, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:39.908474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:40.451107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 934/1852] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:39 2022] PUT /identity/v3/projects/9b9ac74d2a624f95a19e70c0c1c7f1cf/users/56de23f2f8ed4f62a4760f1b035f402d/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:40.461540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:40.462028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:40.462127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:40.510009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] MFA Rules not processed for user `56de23f2f8ed4f62a4760f1b035f402d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:40.511525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:40.607847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 919/1853] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:40.623763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:40.625618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:40.709923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193bad-008a-406c-820f-a28b0c5c11e2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:40.714833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:40.715712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:40.716283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:40.717386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:40.734297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:40.737104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c0db-3ee1-4f71-8056-a39437cf8d48 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:40.756777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 935/1854] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:40.790834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:42.582642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:43.563114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:44.016552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:44.020088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:44.096030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97b097-36f8-457d-9bdc-d306ed5d78e4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:44.101648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:44.102770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:44.103113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:44.103403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] PATH_INFO: `/v3/users/41a63995982745feaa3514409a6b5447` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:44.104683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a63995982745feaa3514409a6b5447)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:44.106604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:44.381795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a63995982745feaa3514409a6b5447'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:44.382777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a63995982745feaa3514409a6b5447'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:44.398078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a63995982745feaa3514409a6b5447'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:44.494357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a63995982745feaa3514409a6b5447'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:44.508658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a63995982745feaa3514409a6b5447'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:44.518459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 920/1855] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:44 2022] DELETE /identity/v3/users/41a63995982745feaa3514409a6b5447 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:44.524306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:44.524973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:44.525252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:44.545601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:44.546851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:44.625440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:44.666639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 936/1856] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:44.680235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:44.682054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:44.798741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96169d26-3869-491a-ab49-c4da77205338 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:44.806075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:44.806757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:44.807046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:44.807325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:44.835974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:44.837928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e0f0-a13d-4949-b945-71b2e64b1928 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:44.872635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 921/1857] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:45.596594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:46.029600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:46.031375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:46.054498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be827e98-c476-45d7-ab89-d004fe6b9b08 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:46.066056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:46.066527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.067262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.068370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] PATH_INFO: `/v3/projects/80f47260b5da4e82b661ae4a287c7011` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.070810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f47260b5da4e82b661ae4a287c7011)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:46.074681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:46.161618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae809f-5039-4eca-a9fc-50dc20b16f2d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.163309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae809f-5039-4eca-a9fc-50dc20b16f2d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.163737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae809f-5039-4eca-a9fc-50dc20b16f2d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.171119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 922/1858] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:54:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:54:46.184052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.185573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.185573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.208001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:46.210067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:46.280121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f47260b5da4e82b661ae4a287c7011', 'request_id': 'req-1f2ea2b9-a95a-4026-bf80-06be6626ba36'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.294859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 923/1859] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:46.307217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:46.308744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:46.322503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2232-de6e-4558-b9de-37bc7c00c610 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:46.393682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:46.394385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.395435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.395435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.404382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:46.406087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:46.417602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 924/1860] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:46.418474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:46.419999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:46.438905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f47260b5da4e82b661ae4a287c7011', 'request_id': 'req-1f2ea2b9-a95a-4026-bf80-06be6626ba36'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.449488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f47260b5da4e82b661ae4a287c7011', 'request_id': 'req-1f2ea2b9-a95a-4026-bf80-06be6626ba36'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.463033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] The token cache is being invalidate because project 80f47260b5da4e82b661ae4a287c7011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:46.463381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.465381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.470304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 937/1861] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:46 2022] DELETE /identity/v3/projects/80f47260b5da4e82b661ae4a287c7011 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:46.470304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:46.471477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:46.516757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781924-0931-4c96-af9d-6937964971ea service placement] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:46.522367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:46.523571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.523747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.524521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] PATH_INFO: `/v3/users/c35ea03f098c42d9913bf17e75089c2f` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.525767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35ea03f098c42d9913bf17e75089c2f)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:46.527607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:46.566782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea2b9-a95a-4026-bf80-06be6626ba36 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:46.578878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:46.580551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:46.580831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:46.581101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] PATH_INFO: `/v3/users/b98130e815054b67a6c1eb6a5faaad63` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:46.582451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98130e815054b67a6c1eb6a5faaad63)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:46.585787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:46.805965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35ea03f098c42d9913bf17e75089c2f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.806752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35ea03f098c42d9913bf17e75089c2f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.821475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35ea03f098c42d9913bf17e75089c2f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.949240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35ea03f098c42d9913bf17e75089c2f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.954764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98130e815054b67a6c1eb6a5faaad63'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.959274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35ea03f098c42d9913bf17e75089c2f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.963977 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98130e815054b67a6c1eb6a5faaad63'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.965302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98130e815054b67a6c1eb6a5faaad63'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.970203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 925/1862] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:46 2022] DELETE /identity/v3/users/c35ea03f098c42d9913bf17e75089c2f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:46.989544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98130e815054b67a6c1eb6a5faaad63'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:46.991130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98130e815054b67a6c1eb6a5faaad63'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.108690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 938/1863] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:46 2022] DELETE /identity/v3/users/b98130e815054b67a6c1eb6a5faaad63 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:47.283118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:47.296978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:47.377628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef09b83-b0d9-442d-8bc8-92e20ccdec93 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:47.450148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:47.451075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.451622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.451622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] PATH_INFO: `/v3/projects/e2e6ed45b8a4412b95f3b8a5ae268a91` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.452888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e6ed45b8a4412b95f3b8a5ae268a91)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:47.454814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:47.591139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:47.601066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:47.601066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:47.613316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e6ed45b8a4412b95f3b8a5ae268a91', 'request_id': 'req-f54f7a98-6c1b-4c5f-998c-0f034931941f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.615130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42c76-f491-41f4-a7a0-4afae8891391 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:47.680667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:47.681544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.681824 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.682093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] PATH_INFO: `/v3/projects/3b51f99c18db412ea2f7e90b15f51964` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.683363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b51f99c18db412ea2f7e90b15f51964)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:47.685861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:47.710385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e6ed45b8a4412b95f3b8a5ae268a91', 'request_id': 'req-f54f7a98-6c1b-4c5f-998c-0f034931941f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.741080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e6ed45b8a4412b95f3b8a5ae268a91', 'request_id': 'req-f54f7a98-6c1b-4c5f-998c-0f034931941f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.756658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] The token cache is being invalidate because project e2e6ed45b8a4412b95f3b8a5ae268a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:47.756886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.757575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f54f7a98-6c1b-4c5f-998c-0f034931941f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.760564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 926/1864] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:47 2022] DELETE /identity/v3/projects/e2e6ed45b8a4412b95f3b8a5ae268a91 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:47.764610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341406f-b17c-43f2-84b0-27d9f271e4f4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.764922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341406f-b17c-43f2-84b0-27d9f271e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.765203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341406f-b17c-43f2-84b0-27d9f271e4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.786027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d341406f-b17c-43f2-84b0-27d9f271e4f4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:47.788073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d341406f-b17c-43f2-84b0-27d9f271e4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:47.798435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 927/1865] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:47.805259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.805537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.805810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.815927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:47.830404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:47.831632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:47.842441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b51f99c18db412ea2f7e90b15f51964', 'request_id': 'req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.908374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 928/1866] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:47.913329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:47.926889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68cab8-fbbb-407e-bd71-620ded293145 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:47.931379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:47.932183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.932614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.932941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.933918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:47.934418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:47.936796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:47.947729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b51f99c18db412ea2f7e90b15f51964', 'request_id': 'req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.953428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 929/1867] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:54:47.956243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b51f99c18db412ea2f7e90b15f51964', 'request_id': 'req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.957734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:47.970683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330518-2d4d-4206-a949-78d17cb3118b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:47.971517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] The token cache is being invalidate because project 3b51f99c18db412ea2f7e90b15f51964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:47.972001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.972856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-aadcd0f4-f6c3-4179-9d36-0dc7a328c0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:47.975868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 939/1868] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:47 2022] DELETE /identity/v3/projects/3b51f99c18db412ea2f7e90b15f51964 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:47.981700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf997f-578c-47bd-b462-2ce8759764f3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.982323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf997f-578c-47bd-b462-2ce8759764f3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.982598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:47.983056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf997f-578c-47bd-b462-2ce8759764f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.983539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:47.983919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:47.990088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:47.990088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:47.990088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.007244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-51cf997f-578c-47bd-b462-2ce8759764f3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:48.008899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-51cf997f-578c-47bd-b462-2ce8759764f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:48.019063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 940/1869] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:48.029010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.029497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.029987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.054525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:48.055758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:48.065397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 941/1870] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:48.072067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.082440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ddfa-7ed7-4d0e-b2ad-1f6808a50c08 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.087427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.088149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.088442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.088720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.089607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:48.089914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.091552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.113335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 942/1871] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:54:48.117585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.132603 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc994b1-1a99-4220-9bf0-23778e7b981e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.145418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.148013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.148996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.149834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.151217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.153705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.165666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 930/1872] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:47 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:48.174966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.180170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:48.255656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b6bc6-6276-4c70-910f-790cadf5a966 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.260438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.261022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 943/1873] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:48.261140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.261400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.261677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.262379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.264346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.265355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.337864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1f74-2718-47f3-a093-16a17d2cbd74 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.344436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.345165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.345451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.345865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.346673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.348775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.371795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 931/1874] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:48.375231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.389302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbb84c-ba0e-491a-8fdc-99fd1de809e7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.394616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.395293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.395626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.395955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.396695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.398304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.409015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 932/1875] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:48.413102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.422984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb449ba-e721-498b-8412-80e81164e1fe admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.428263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.428931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.429213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.429492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.430232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.431835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.444850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 944/1876] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:48.444955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 933/1877] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:48.449084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.449212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.460368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34228c5-582b-468c-8cf6-1554434ddd80 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.461049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0881c-2228-4406-bc98-602bf07cfcba admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.466307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.466609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.467194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.467575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.467689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.467952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.468051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.468289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] PATH_INFO: `/v3/projects/abcade54abcd4d7b93a5c425d5ccbcc1/users/001050fa488f4697ba27e8be297d2ffa/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.468849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.477766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.483953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 945/1878] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:48.485251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcade54abcd4d7b93a5c425d5ccbcc1, user_id=001050fa488f4697ba27e8be297d2ffa, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.487963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a163ab1-11c0-4bf5-a6f9-9b7fdf8b3d02 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.488117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.498999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20808f-2977-4bca-9bfb-1f48c391a264 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.503926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.504614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.505063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.506106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.506764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.508451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.521099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 946/1879] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:48.525504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.536718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e32c-84cc-4b9a-8424-92e1192149ab admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.541775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.542658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.542940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.543217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] PATH_INFO: `/v3/projects/c6edff197699430a96d1bdfb4778b07c/users/13b89fe0113d4dc6874e50e9116c4888/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.559448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6edff197699430a96d1bdfb4778b07c, user_id=13b89fe0113d4dc6874e50e9116c4888, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.562488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ec18c-3c21-4d20-9528-d89aa74abd8b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.579238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 934/1880] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:48 2022] PUT /identity/v3/projects/abcade54abcd4d7b93a5c425d5ccbcc1/users/001050fa488f4697ba27e8be297d2ffa/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:48.590250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.590540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.590822 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.620449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] MFA Rules not processed for user `001050fa488f4697ba27e8be297d2ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:48.621931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:48.623006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 947/1881] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:48 2022] PUT /identity/v3/projects/c6edff197699430a96d1bdfb4778b07c/users/13b89fe0113d4dc6874e50e9116c4888/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:48.634441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.634871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.635158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.673699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] MFA Rules not processed for user `13b89fe0113d4dc6874e50e9116c4888`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:48.674958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:48.698831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 935/1882] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:48.705464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.782575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 948/1883] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:48.787598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.796635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4416-b69d-47da-88f4-e312fcd03543 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.802227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88f9d-b7b7-40f3-b743-301b5ca1c112 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.805166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.805858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.806139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.806308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.806618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.807062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.808062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.808226 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.808314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.808695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.809719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.810829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.911828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 936/1885] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:48.912043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 949/1885] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:48.913248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.913351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:48.984099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658fce9-4d9d-4c75-a5a7-0bce4a65ac7a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.984412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41a29f-f013-4b42-aef2-af2bc89387fa admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:48.990399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.991083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.991446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.991840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:48.991974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.992490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:48.992578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.992784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:48.993062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:48.993779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:48.994466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:48.995686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.144018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 950/1886] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:49.145994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 937/1887] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:48 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:49.148577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.150571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.160912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a327-512b-4672-978b-e51c856eb65e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.164742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f454f4-a7fc-4daf-bb35-38458c83a49f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.166017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.166774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.167054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.167331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.168775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.169750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.171424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.172302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.174869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.174869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.174869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.175468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.183297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 951/1888] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:49.188267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.189269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 938/1889] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:49.194000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.201956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9970-4c76-4fd5-a99c-d1a89145869d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.206691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873d5b1-34ff-4664-a645-00a17d1a4ab7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.209082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.210283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.210566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.210847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] PATH_INFO: `/v3/projects/7ab8f537514a4039b12889b37186d40a/users/b507c09c70da4b418f7c85401c8b5d38/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.213082 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.214185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.214619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.215030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] PATH_INFO: `/v3/projects/9da53f7f078344d7a10f603f3653d8e5/users/67bcb6d990db4298a64a096dc6534310/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.231613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab8f537514a4039b12889b37186d40a, user_id=b507c09c70da4b418f7c85401c8b5d38, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.234714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.238086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da53f7f078344d7a10f603f3653d8e5, user_id=67bcb6d990db4298a64a096dc6534310, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.241760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.382905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 939/1890] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:49 2022] PUT /identity/v3/projects/9da53f7f078344d7a10f603f3653d8e5/users/67bcb6d990db4298a64a096dc6534310/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:49.383576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 952/1891] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:49 2022] PUT /identity/v3/projects/7ab8f537514a4039b12889b37186d40a/users/b507c09c70da4b418f7c85401c8b5d38/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:49.386999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.387120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.417139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:49.451479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559eb7-085b-4fa9-a354-1b4071f522e8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.453046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020303-f771-4660-aa80-1ab9e987532d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.456227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.456893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.457174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.457443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.457911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.458243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.459526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.459833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.460117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.460499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.460853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.462474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.471221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 940/1892] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:49.476010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 953/1893] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:49.476205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.476985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.486067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1626-519b-4ea5-b535-e72ea1d04551 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.487294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e427b8-4560-48e4-86cd-c6ee1ee750df admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.491466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.492388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.492523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.492684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.492931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] PATH_INFO: `/v3/projects/9da53f7f078344d7a10f603f3653d8e5/users/67bcb6d990db4298a64a096dc6534310/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.493269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.493548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.493820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] PATH_INFO: `/v3/projects/7ab8f537514a4039b12889b37186d40a/users/b507c09c70da4b418f7c85401c8b5d38/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.494918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da53f7f078344d7a10f603f3653d8e5, user_id=67bcb6d990db4298a64a096dc6534310, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.496123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab8f537514a4039b12889b37186d40a, user_id=b507c09c70da4b418f7c85401c8b5d38, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.497751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c8f20-fd15-4f82-aabf-73cc013206ae admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.498928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329cb17-0bc4-4658-a236-db32efa2a2d1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.509288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 941/1894] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:49 2022] PUT /identity/v3/projects/9da53f7f078344d7a10f603f3653d8e5/users/67bcb6d990db4298a64a096dc6534310/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:49.518189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 954/1895] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:49 2022] PUT /identity/v3/projects/7ab8f537514a4039b12889b37186d40a/users/b507c09c70da4b418f7c85401c8b5d38/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:49.520346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.521501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.521936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.530529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.530814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.531093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.551868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] MFA Rules not processed for user `67bcb6d990db4298a64a096dc6534310`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:49.553123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:49.559772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] MFA Rules not processed for user `b507c09c70da4b418f7c85401c8b5d38`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:49.561011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:49.626338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 942/1896] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:49.632992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 955/1897] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:49.637727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.639192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:49.700663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76eaa-b42a-4cc5-b119-986df1ef4c96 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.704188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.704830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.705110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.705381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.715435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.716884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.727522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 943/1898] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:49.750745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:49.760596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f339b-6f15-4b3c-977c-ff3e4d57a3a7 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:49.764345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:49.764983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:49.765271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:49.765549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:49.775726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:49.777217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:49.787629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 956/1899] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:50.010971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:50.019626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a7bd-1e5b-4ac7-97d5-af25806c5c74 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:50.024386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:50.025062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:50.025345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:50.025642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:50.088636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:50.091163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:50.101301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 944/1900] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:50.121688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:50.979898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:50.981318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:50.983240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:50.996047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27d83-a57d-4593-8d44-782cdd6b5d7a service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:51.001673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:51.002754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:51.003655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:51.004453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:51.007017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:51.054399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:51.069620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f565e0-976b-4530-b617-9d4fe1efd3f2 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:51.074428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:51.075313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:51.075737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:51.076012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] PATH_INFO: `/v3/users/56de23f2f8ed4f62a4760f1b035f402d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:51.077283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56de23f2f8ed4f62a4760f1b035f402d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:51.077973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:51.079227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:51.079457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989cb37-00e6-4591-893b-d38b87b2ac68 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:51.089868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 945/1901] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:51.311030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56de23f2f8ed4f62a4760f1b035f402d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:51.318876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56de23f2f8ed4f62a4760f1b035f402d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:51.321302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56de23f2f8ed4f62a4760f1b035f402d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:51.335934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56de23f2f8ed4f62a4760f1b035f402d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:51.339130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56de23f2f8ed4f62a4760f1b035f402d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:51.448269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 957/1902] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:50 2022] DELETE /identity/v3/users/56de23f2f8ed4f62a4760f1b035f402d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:51.451654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:51.451988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:51.452275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:51.469892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:51.471148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:51.503619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:51.535452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 946/1903] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:51.545950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:51.548241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:51.616526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58bd2-be04-4110-a6d8-df4d95f2c972 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:51.620695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:51.621593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:51.621877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:51.622151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:51.637010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:51.639040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a3419-3fac-4216-8274-070153eb5cf5 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:51.651742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 958/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:52.156960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:52.156960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:52.166040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b703e-ad89-4687-850b-537f39dd3270 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:52.175117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:52.176285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.176644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.177188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] PATH_INFO: `/v3/projects/9b9ac74d2a624f95a19e70c0c1c7f1cf` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.178828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9ac74d2a624f95a19e70c0c1c7f1cf)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:52.181340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:52.322497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9ac74d2a624f95a19e70c0c1c7f1cf', 'request_id': 'req-beb21d7e-3fcc-4e57-8506-a670444c1159'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:52.410512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9ac74d2a624f95a19e70c0c1c7f1cf', 'request_id': 'req-beb21d7e-3fcc-4e57-8506-a670444c1159'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:52.418212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9ac74d2a624f95a19e70c0c1c7f1cf', 'request_id': 'req-beb21d7e-3fcc-4e57-8506-a670444c1159'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:52.429909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] The token cache is being invalidate because project 9b9ac74d2a624f95a19e70c0c1c7f1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:52.430204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:52.430943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-beb21d7e-3fcc-4e57-8506-a670444c1159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:52.438810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 947/1905] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:52 2022] DELETE /identity/v3/projects/9b9ac74d2a624f95a19e70c0c1c7f1cf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:52.444640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.445576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.449110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.466816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:52.468087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:52.542102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 959/1906] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:52.549730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.549930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.550212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.578384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:52.579644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:52.592866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 948/1907] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:52.597830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:52.608058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f33b8-e4f8-4f03-ad35-5019a1eb7e92 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:52.623958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:52.623958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.623958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.623958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.624316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:52.624316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:52.624316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:52.635256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 960/1908] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:54:52.639887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:52.650026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e077-030c-4eb3-be2b-d7a8cc34fbec None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:52.655626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:52.656343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.656859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.657304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.658161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:52.660549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:52.764129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 949/1909] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:52 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:52.765548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:52.787564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:52.796177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c78a2-c2be-46d9-838a-1ba071be4e89 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:52.870453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:52.870453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:52.870744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:52.871007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:52.871973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:52.874174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.007279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 961/1910] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:52 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:53.009032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.027290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2ada-8570-4318-bbed-9eb42096ff0b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.037119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.037119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.037119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.037119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.041020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.041020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.052193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 950/1911] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:53.056376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.066789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f36-938e-4cd5-8a57-f12fa7e2c293 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.072472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.073150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.073430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.073702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.074442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.076120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df139d6e-5414-44ad-bbab-7d00f358a503 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.087981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 962/1912] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:53.092441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.103681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609aa10-a7a0-4ee1-b9a6-8a7c1c56fc23 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.109642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.114026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.114026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.114026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] PATH_INFO: `/v3/projects/29e2f253426641a490437edef1d1dd2b/users/dce603b4787d40c7bf4a64823cf9cae9/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.127216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e2f253426641a490437edef1d1dd2b, user_id=dce603b4787d40c7bf4a64823cf9cae9, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.129931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.213118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:53.249018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 951/1913] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:53 2022] PUT /identity/v3/projects/29e2f253426641a490437edef1d1dd2b/users/dce603b4787d40c7bf4a64823cf9cae9/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:53.260659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.261182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.261468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.293186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] MFA Rules not processed for user `dce603b4787d40c7bf4a64823cf9cae9`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:53.294480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:53.374602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 963/1914] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:53.379423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.446786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c197da-baa6-4446-b9d5-484025a45bae admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.451576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.452272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.452556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.452833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.453532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.455452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.562924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 952/1915] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:53 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:53.567149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.578624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7722d64-fd9c-4903-9169-74dfafe2adec None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.586346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.588141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:53.658825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f607d-858f-4677-a4ed-9e94d1001799 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.659920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.660761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.661945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.662345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.663064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.664828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.665091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.665731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.666016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.666313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] PATH_INFO: `/v3/users/13b89fe0113d4dc6874e50e9116c4888` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.667537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b89fe0113d4dc6874e50e9116c4888)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.669513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.746657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 964/1916] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:53 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:53.750183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.761449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778c3f-855f-4850-8b27-ce1dbd3430c9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.768506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.768506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.768506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.768506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.769328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.771862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.783336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 965/1917] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:53.788063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.799165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ba4-0cdf-4c50-875c-a668a00ba69d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.804817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.805526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.805804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.806078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.806820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.808469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.824078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 966/1918] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:53.828161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.838911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8522-ec18-4c58-9a8b-7e024a06a01d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:53.843956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:53.844875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.845869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.845869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] PATH_INFO: `/v3/projects/5d3450e731f0430598ef55c7817a0024/users/acd944f35e5f4c3ca7c4232105ca0636/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.856862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b89fe0113d4dc6874e50e9116c4888'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:53.857617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b89fe0113d4dc6874e50e9116c4888'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:53.862440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3450e731f0430598ef55c7817a0024, user_id=acd944f35e5f4c3ca7c4232105ca0636, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:53.865380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:53.870726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b89fe0113d4dc6874e50e9116c4888'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:53.937619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b89fe0113d4dc6874e50e9116c4888'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:53.944090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 967/1919] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:53 2022] PUT /identity/v3/projects/5d3450e731f0430598ef55c7817a0024/users/acd944f35e5f4c3ca7c4232105ca0636/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:53.953230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:53.953230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:53.953442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-baa94a6e-7dd7-4207-8999-26885dafa199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b89fe0113d4dc6874e50e9116c4888'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:53.953731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 953/1920] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:53 2022] DELETE /identity/v3/users/13b89fe0113d4dc6874e50e9116c4888 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:53.955142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160519-00bf-4d89-b54d-a16d6b82b27c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:53.955430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160519-00bf-4d89-b54d-a16d6b82b27c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:53.955701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160519-00bf-4d89-b54d-a16d6b82b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:53.983972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a0160519-00bf-4d89-b54d-a16d6b82b27c None None] MFA Rules not processed for user `acd944f35e5f4c3ca7c4232105ca0636`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:53.985189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a0160519-00bf-4d89-b54d-a16d6b82b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.015164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65097c4-8184-43b9-a8a5-fbcdb6444f92 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.063962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 954/1921] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:54.065565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.067146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.068000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.087837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.088955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.089242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.089518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] PATH_INFO: `/v3/users/001050fa488f4697ba27e8be297d2ffa` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.090778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001050fa488f4697ba27e8be297d2ffa)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.092937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.093585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:54.095088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.105078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 955/1922] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:54.105950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.107747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.121365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad72d9-f75d-4267-ba3e-6de56bd2a376 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.126956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.127736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.128113 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.128396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.129175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.131306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.153506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:54.235826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 956/1923] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:54.237120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.240189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.311973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9075b-3524-4956-b1f5-24a2181ef6c0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.322972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.324120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.324620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.325035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.325125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001050fa488f4697ba27e8be297d2ffa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:54.338479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001050fa488f4697ba27e8be297d2ffa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:54.339589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001050fa488f4697ba27e8be297d2ffa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:54.359709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001050fa488f4697ba27e8be297d2ffa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:54.360762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd22edc4-4e96-4ae7-a834-b302f73561c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001050fa488f4697ba27e8be297d2ffa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:54.393776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.395214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.405152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 957/1924] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:54.406018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.415151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440a4a4-88ed-45f0-be78-d57bd255a5a7 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.420011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.420672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.420990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.421222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.422217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.423844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.434969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 968/1925] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:53 2022] DELETE /identity/v3/users/001050fa488f4697ba27e8be297d2ffa => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:54.439420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.439735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.440036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.458617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:54.459895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.522179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 958/1926] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:54 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:54.523168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 969/1927] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:54.526455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.529244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.534446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.536787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.544149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c73a-c027-40e8-afb9-8864f5ab1e46 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.548955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.549627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.549913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.550191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.551232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.553258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.563850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 959/1928] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:54.567906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.578315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64016-d013-4e37-881d-ee03d64c88b5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.583201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.585652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.585652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.585652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] PATH_INFO: `/v3/projects/b58574f302934120989464e2130eca77/users/2e28a02f1dcf40cca5397cf70578bbcc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.600689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58574f302934120989464e2130eca77, user_id=2e28a02f1dcf40cca5397cf70578bbcc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.602017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a769-3108-402a-99d9-c1ef17765da3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.603311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.607064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.607934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.608222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.608556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.619531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.621295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.632800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 970/1929] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:54.681747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 960/1930] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:54 2022] PUT /identity/v3/projects/b58574f302934120989464e2130eca77/users/2e28a02f1dcf40cca5397cf70578bbcc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:54.686157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.697810 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a61d-f920-47b3-afc1-596cc80c9269 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.784077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.784763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.785043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.785316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.786717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.789046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3f7ed-609a-40f5-9a50-6de07e3fff1c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.802508 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 971/1931] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:54.805972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.820294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:54.824055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094fdaa-a1c0-4a15-84a4-93e91171a3b9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:54.830578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:54.831244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.831724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.832185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] PATH_INFO: `/v3/projects/b58574f302934120989464e2130eca77/users/2e28a02f1dcf40cca5397cf70578bbcc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.835345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58574f302934120989464e2130eca77, user_id=2e28a02f1dcf40cca5397cf70578bbcc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:54.838649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:54.852470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 961/1932] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:54 2022] PUT /identity/v3/projects/b58574f302934120989464e2130eca77/users/2e28a02f1dcf40cca5397cf70578bbcc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:54.865433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:54.865813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:54.866104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:54.894789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] MFA Rules not processed for user `2e28a02f1dcf40cca5397cf70578bbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:54.897106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.941491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:54.943933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:54.986960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 972/1933] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:55.000287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:55.004672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:55.051914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1d0b9-bd8b-4beb-80c3-8eb026782639 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:55.057754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:55.058799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:55.059086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:55.059407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] PATH_INFO: `/v3/projects/c6edff197699430a96d1bdfb4778b07c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:55.060863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6edff197699430a96d1bdfb4778b07c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:55.063194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:55.077008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a76c0-a4c1-4359-8a6d-bccfadc8f258 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:55.080764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:55.081416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:55.081697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:55.081975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:55.084764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:55.152996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:55.154428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:55.165348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 973/1934] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:55.166190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:55.167630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:55.182468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647efe-6463-45f4-8457-78cc020df18e service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:55.187849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:55.189186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:55.189520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:55.189884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] PATH_INFO: `/v3/projects/abcade54abcd4d7b93a5c425d5ccbcc1` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:55.191720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abcade54abcd4d7b93a5c425d5ccbcc1)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:55.195202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:55.234059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6edff197699430a96d1bdfb4778b07c', 'request_id': 'req-504a8842-9337-4858-8128-93859c808da7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.321501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6edff197699430a96d1bdfb4778b07c', 'request_id': 'req-504a8842-9337-4858-8128-93859c808da7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.329461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6edff197699430a96d1bdfb4778b07c', 'request_id': 'req-504a8842-9337-4858-8128-93859c808da7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.358713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcade54abcd4d7b93a5c425d5ccbcc1', 'request_id': 'req-cd154947-493e-47bd-9df2-f83e0232b63e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.359609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] The token cache is being invalidate because project c6edff197699430a96d1bdfb4778b07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:55.362411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.365348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.368197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 962/1935] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:54 2022] DELETE /identity/v3/projects/c6edff197699430a96d1bdfb4778b07c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:55.372106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:55.373755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:55.436201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcade54abcd4d7b93a5c425d5ccbcc1', 'request_id': 'req-cd154947-493e-47bd-9df2-f83e0232b63e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.445638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcade54abcd4d7b93a5c425d5ccbcc1', 'request_id': 'req-cd154947-493e-47bd-9df2-f83e0232b63e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.448187 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a8842-9337-4858-8128-93859c808da7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:55.460930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] The token cache is being invalidate because project abcade54abcd4d7b93a5c425d5ccbcc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:55.461245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.461946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.463789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 974/1936] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:55 2022] DELETE /identity/v3/projects/abcade54abcd4d7b93a5c425d5ccbcc1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:55.467703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:55.469433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:55.523184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:55.528749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:55.528749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:55.528749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] PATH_INFO: `/v3/users/67bcb6d990db4298a64a096dc6534310` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:55.528749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bcb6d990db4298a64a096dc6534310)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:55.529165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:55.558049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd154947-493e-47bd-9df2-f83e0232b63e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:55.563974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:55.564871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:55.565162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:55.565427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] PATH_INFO: `/v3/users/b507c09c70da4b418f7c85401c8b5d38` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:55.566654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b507c09c70da4b418f7c85401c8b5d38)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:55.569445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:55.759167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bcb6d990db4298a64a096dc6534310'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.760043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bcb6d990db4298a64a096dc6534310'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.772893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bcb6d990db4298a64a096dc6534310'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.799098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b507c09c70da4b418f7c85401c8b5d38'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.807490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b507c09c70da4b418f7c85401c8b5d38'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.808170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b507c09c70da4b418f7c85401c8b5d38'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.821371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b507c09c70da4b418f7c85401c8b5d38'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.822117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b507c09c70da4b418f7c85401c8b5d38'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.865167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bcb6d990db4298a64a096dc6534310'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.877869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bcb6d990db4298a64a096dc6534310'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:55.888594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 963/1937] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:55 2022] DELETE /identity/v3/users/67bcb6d990db4298a64a096dc6534310 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:55.962653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 975/1938] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:55 2022] DELETE /identity/v3/users/b507c09c70da4b418f7c85401c8b5d38 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:56.279308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:56.402136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.403695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.423993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.425774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.504225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23b75-350c-47d9-9c3f-7595acd70135 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.509181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c753c-3603-41d2-a9e0-a7622ca2195f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.512151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.512151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.512448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.512540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] PATH_INFO: `/v3/projects/9da53f7f078344d7a10f603f3653d8e5` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.513691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da53f7f078344d7a10f603f3653d8e5)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.514032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.514936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.515351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.515492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] PATH_INFO: `/v3/projects/7ab8f537514a4039b12889b37186d40a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.515608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:56.516750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab8f537514a4039b12889b37186d40a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.518742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:56.618670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da53f7f078344d7a10f603f3653d8e5', 'request_id': 'req-4d603e18-89f2-4280-9247-4bef7149f30f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.630755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:56.648894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab8f537514a4039b12889b37186d40a', 'request_id': 'req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.698974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da53f7f078344d7a10f603f3653d8e5', 'request_id': 'req-4d603e18-89f2-4280-9247-4bef7149f30f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.706626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da53f7f078344d7a10f603f3653d8e5', 'request_id': 'req-4d603e18-89f2-4280-9247-4bef7149f30f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.719849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] The token cache is being invalidate because project 9da53f7f078344d7a10f603f3653d8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:56.720192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.720849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4d603e18-89f2-4280-9247-4bef7149f30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.722448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 964/1939] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:56 2022] DELETE /identity/v3/projects/9da53f7f078344d7a10f603f3653d8e5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:56.729367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b6b5-2250-4be7-bbbc-caecc426f02f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.729705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b6b5-2250-4be7-bbbc-caecc426f02f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.729989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b6b5-2250-4be7-bbbc-caecc426f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.756747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-3788b6b5-2250-4be7-bbbc-caecc426f02f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:56.758425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3788b6b5-2250-4be7-bbbc-caecc426f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.789593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab8f537514a4039b12889b37186d40a', 'request_id': 'req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.797520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab8f537514a4039b12889b37186d40a', 'request_id': 'req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.810352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] The token cache is being invalidate because project 7ab8f537514a4039b12889b37186d40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:54:56.812268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.813529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dcf9cb2c-ca8b-4844-a22a-b2cca00645d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:54:56.816048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 976/1940] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:54:56 2022] DELETE /identity/v3/projects/7ab8f537514a4039b12889b37186d40a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:56.822875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb287-6e93-49a2-ae17-7a452ea8f54e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.823528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb287-6e93-49a2-ae17-7a452ea8f54e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.824140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb287-6e93-49a2-ae17-7a452ea8f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.835909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 965/1941] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:56.853678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.853916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.854393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.860463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-98fcb287-6e93-49a2-ae17-7a452ea8f54e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:56.862803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-98fcb287-6e93-49a2-ae17-7a452ea8f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.875554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 977/1942] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:56.876672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:56.878029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.885388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.885707 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.885941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.893964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 966/1943] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:56.899195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.908270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:56.909733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:56.911946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd6272-9106-48ec-8f7f-935789fd5074 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.917865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.918903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.919360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.919780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.923339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 978/1944] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:56.928000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:56.928126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.928206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.928206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:56.940666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3ecf-95d5-4179-8531-4927a3507e3c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.941644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 967/1945] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:56.946700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.949344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.950910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.950910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.950910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.951640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:54:56.951931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.953545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:56.957043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46120f2-e4dc-4905-938b-627b7df510b4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.962750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.963431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.963714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.964048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.964755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.966681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:56.967530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 979/1946] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:54:56.972189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:56.982757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c1f8-a6f1-4ef6-b0b2-bbd9172226d9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:56.987399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:56.988086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:56.988363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:56.988631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:56.989958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:56.991989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.123770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 968/1947] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:57.126676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 980/1948] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:56 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:57.127977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.131057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.200564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38ad-48ee-4e25-9c4a-0de37726ef06 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.201385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984efeb4-1af3-4305-adda-f8ffc09d852c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.206283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.206888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.207009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.207281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.207560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.209140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.209471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.213736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.213736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.213736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.214008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.214083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.350091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 981/1949] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/users => generated 305 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:57.351553 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 969/1950] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:57.354906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.356468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.370823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2095b-84b1-46b9-bc80-b0aa47ebb3f6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.376023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.376328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.376664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.376959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.377688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.379296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.389324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e72f6-2e20-4693-b9b5-d9c4db7fa3ac admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.393035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 970/1951] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:57.396596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.396596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.396596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.397065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.397656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.399298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.399774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.411731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 982/1952] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:57.416254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.420381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8063b4-42fb-4b28-a554-e2833094b30e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.428551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.428551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.428551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.428551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.429295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d8ea8-3c06-47cf-b4b9-922e0b459dda admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.429399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.431026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.433428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.434395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.434923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.435307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.436554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.438281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.451358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 971/1953] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:57.451358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.451659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 983/1954] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:57.451750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:57.452980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.464029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040ebf-fca8-49d4-aa5b-cee359e15606 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.469381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.470333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.470629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.470894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] PATH_INFO: `/v3/projects/9c7007aca50b4641b2651651e1d07923/users/a82d59b9b7b84103aa83e00b7230f818/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.492727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7007aca50b4641b2651651e1d07923, user_id=a82d59b9b7b84103aa83e00b7230f818, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.495564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.513432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252761a2-6fb1-4a93-8967-99ef260618c6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.517186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.517836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.518126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.518402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.521368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:57.579367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 984/1955] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:57 2022] PUT /identity/v3/projects/9c7007aca50b4641b2651651e1d07923/users/a82d59b9b7b84103aa83e00b7230f818/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:57.580372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.582223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.584387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f86bd-569d-4230-b539-7e7df96f9ba9 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.594954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 972/1956] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:57.596563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.596855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.597167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.608880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.631596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] MFA Rules not processed for user `a82d59b9b7b84103aa83e00b7230f818`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:57.632947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:57.667353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13eeaf-8283-498d-b479-87e7e378e4f8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.673625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.674865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.675316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.675760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] PATH_INFO: `/v3/projects/6a227840d03d43e592617d2a8cfd37a5/users/1d981b0bc7fd43c9968b6a8c0dc5cc0e/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.697208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a227840d03d43e592617d2a8cfd37a5, user_id=1d981b0bc7fd43c9968b6a8c0dc5cc0e, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.701192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f86b5-70d1-4b84-b07f-722a554a0520 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.720106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 973/1957] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:54:57.725474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.736618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac39d-2672-4e0b-a879-61657cdb7813 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.742646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.743757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.743757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.744067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.744783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.746682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:57.808274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 985/1958] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:57 2022] PUT /identity/v3/projects/6a227840d03d43e592617d2a8cfd37a5/users/1d981b0bc7fd43c9968b6a8c0dc5cc0e/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:57.819079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.819716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.819716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.846585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] MFA Rules not processed for user `1d981b0bc7fd43c9968b6a8c0dc5cc0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:57.847830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:57.861741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 974/1959] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/projects => generated 407 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:57.863403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.933135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 986/1960] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:57.938306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:57.945293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21081-aff5-4eff-ab6d-8d9e420f9cf3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:57.951289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:57.952048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:57.952334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:57.952614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:57.953442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:57.956296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.048414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 975/1961] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/users => generated 310 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:58.053876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.070237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aeaa7-9421-4fbe-aebc-7777abbdd742 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.075502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.076383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.076759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.077120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.077933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.080767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.087192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94052-8ce8-4c86-8e0c-416acba3fec7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.092675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.095157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.095445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.096243 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.096550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.098184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.111898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 976/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:58.116119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.126889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736de8-1e4b-4239-8e17-6de0f15925bf admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.132623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.133544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.133836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.134125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] PATH_INFO: `/v3/projects/b912469909714c10b27763c3375fcd54/users/01ab590d5e574a4fac3d2f90a53e23f5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.153989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b912469909714c10b27763c3375fcd54, user_id=01ab590d5e574a4fac3d2f90a53e23f5, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.162618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.174369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 987/1963] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:54:57 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:54:58.179492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.248905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9ed19-ca66-4d83-a70b-bcb219a23208 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.253651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 977/1964] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:58 2022] PUT /identity/v3/projects/b912469909714c10b27763c3375fcd54/users/01ab590d5e574a4fac3d2f90a53e23f5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:58.258930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.261315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:58.312303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.312983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.313263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.313629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.314325 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.316295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.331615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c8cd2-7fbd-4e04-a2d9-a06b6158d331 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.337889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.338607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.338898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.339176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.339957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.341633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.352448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 978/1965] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:58.356709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.367062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb50c-bef6-4671-88ec-76140360bff6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.372308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.373174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.373458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.373735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] PATH_INFO: `/v3/projects/b912469909714c10b27763c3375fcd54/users/01ab590d5e574a4fac3d2f90a53e23f5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.375732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b912469909714c10b27763c3375fcd54, user_id=01ab590d5e574a4fac3d2f90a53e23f5, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.378756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aad7f-6a9d-4356-b2f5-cc22855e984d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.390908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 979/1966] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:58 2022] PUT /identity/v3/projects/b912469909714c10b27763c3375fcd54/users/01ab590d5e574a4fac3d2f90a53e23f5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:58.402145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.402439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.402719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.423547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 988/1967] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:54:58 2022] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:54:58.425680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.436649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592060-2b23-49d2-bf9e-d10f0336e7cd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.437162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] MFA Rules not processed for user `01ab590d5e574a4fac3d2f90a53e23f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:58.438478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:58.496214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.496895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.497178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.498470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.498470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.499910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.509991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 980/1968] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:58.512117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 989/1969] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:54:58.515948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:58.516833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.530642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f966fa4-0ba4-4601-8f3c-7309efa3c2de None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.535643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.536859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.537069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.537344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] PATH_INFO: `/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f/users/790cc20b21094333ba0c5f4bac50ff72/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.552133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fbf782c7b5411b8ad3ec6122c98d6f, user_id=790cc20b21094333ba0c5f4bac50ff72, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.554764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.616596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.618468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:58.631688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 981/1970] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:58 2022] PUT /identity/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f/users/790cc20b21094333ba0c5f4bac50ff72/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:54:58.635936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.680630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cec5b1-ac9b-4201-8093-faac8f468a8f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.702352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd39-0bc6-4ae1-bc2d-75febb080f4e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.706839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.707513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.708383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.708664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.709397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.711178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.726646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 982/1971] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:54:58.740816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:58.750194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.751068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.751425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.751835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.761361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777c36-6d69-4c3d-b723-de686ac7eb29 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:58.766949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:58.768289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.768576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.768851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] PATH_INFO: `/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f/users/790cc20b21094333ba0c5f4bac50ff72/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.771083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fbf782c7b5411b8ad3ec6122c98d6f, user_id=790cc20b21094333ba0c5f4bac50ff72, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.774566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0c44-8181-4039-a401-0656d9edfa4c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.785499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 983/1972] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:54:58 2022] PUT /identity/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f/users/790cc20b21094333ba0c5f4bac50ff72/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:54:58.796654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:58.796952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:58.797242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:58.826353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] MFA Rules not processed for user `790cc20b21094333ba0c5f4bac50ff72`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:54:58.827462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:58.828008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:58.828957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:58.839426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 990/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:54:58.905988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 984/1974] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:54:59.030716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:59.039876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72333-902f-4860-a6bb-c4e010c28e00 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:59.096946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:59.097934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:59.099555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:59.100572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:59.112004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:59.113799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:59.126463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 991/1975] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:59.282256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:59.292780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:59.294771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7f366-8877-40b5-a865-cf16cbaf9272 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:59.298829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:59.299508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:59.299786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:59.300103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:59.303337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31928-6339-4014-922d-8fd9b3872507 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:59.307083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:59.307879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:59.308143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:59.308427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:59.310526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:54:59.370319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:59.371973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:59.382137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 985/1976] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:59.398731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:59.400382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b0bf-dd8a-4bcd-adb3-449cd3b21411 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:54:59.411882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 992/1977] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:54:59.806799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:54:59.853784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:59.877806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc672cd-838c-4979-a7eb-fcef73db65b3 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:54:59.883529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:54:59.884444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:54:59.884731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:54:59.885009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] PATH_INFO: `/v3/users/1d981b0bc7fd43c9968b6a8c0dc5cc0e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:54:59.886217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d981b0bc7fd43c9968b6a8c0dc5cc0e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:54:59.888196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:00.163365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d981b0bc7fd43c9968b6a8c0dc5cc0e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:00.164257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d981b0bc7fd43c9968b6a8c0dc5cc0e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:00.177292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d981b0bc7fd43c9968b6a8c0dc5cc0e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:00.195729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:00.313625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d981b0bc7fd43c9968b6a8c0dc5cc0e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:00.322399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d981b0bc7fd43c9968b6a8c0dc5cc0e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:00.329593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 986/1978] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:54:59 2022] DELETE /identity/v3/users/1d981b0bc7fd43c9968b6a8c0dc5cc0e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:00.335170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:00.335463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:00.335971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:00.355268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:00.356522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:00.447472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 993/1979] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:00.458371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:00.460208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:00.536690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47728-32e3-4c1e-97c5-80e73a468c7b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:00.542363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:00.543069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:00.543367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:00.543651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:00.565940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:00.568674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:00.580216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 987/1980] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:01.076242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:01.077943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:01.091699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a61c-5cba-4394-b639-a7d62223b19c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:01.099464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:01.100898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:01.101338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:01.101740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] PATH_INFO: `/v3/projects/6a227840d03d43e592617d2a8cfd37a5` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:01.103536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a227840d03d43e592617d2a8cfd37a5)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:01.107874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:01.329271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a227840d03d43e592617d2a8cfd37a5', 'request_id': 'req-1479af78-b422-47d0-b9c4-e2fe16ba745e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.375576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:01.401249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a227840d03d43e592617d2a8cfd37a5', 'request_id': 'req-1479af78-b422-47d0-b9c4-e2fe16ba745e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.408440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a227840d03d43e592617d2a8cfd37a5', 'request_id': 'req-1479af78-b422-47d0-b9c4-e2fe16ba745e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.420763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] The token cache is being invalidate because project 6a227840d03d43e592617d2a8cfd37a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:01.421185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.421864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.423627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 994/1981] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:01 2022] DELETE /identity/v3/projects/6a227840d03d43e592617d2a8cfd37a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:01.427692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:01.437850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45484982-6b91-4e36-8c5e-153ef2c76b23 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:01.511895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:01.512805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:01.513088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:01.513362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] PATH_INFO: `/v3/users/790cc20b21094333ba0c5f4bac50ff72` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:01.514579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790cc20b21094333ba0c5f4bac50ff72)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:01.517876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:01.732668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790cc20b21094333ba0c5f4bac50ff72'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.733764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790cc20b21094333ba0c5f4bac50ff72'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.749406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790cc20b21094333ba0c5f4bac50ff72'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.802634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:01.841301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790cc20b21094333ba0c5f4bac50ff72'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.850492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5864dbd6-ec4a-4c85-9cf2-5cc980b9c637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790cc20b21094333ba0c5f4bac50ff72'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:01.857941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 988/1982] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:01 2022] DELETE /identity/v3/users/790cc20b21094333ba0c5f4bac50ff72 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:02.317498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:02.319714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:02.338882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479af78-b422-47d0-b9c4-e2fe16ba745e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:02.404063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:02.404931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:02.405221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:02.405492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] PATH_INFO: `/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:02.409072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fbf782c7b5411b8ad3ec6122c98d6f)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:02.409072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:02.560926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fbf782c7b5411b8ad3ec6122c98d6f', 'request_id': 'req-9794d903-cec9-4da5-8362-b02e969545ea'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:02.630316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fbf782c7b5411b8ad3ec6122c98d6f', 'request_id': 'req-9794d903-cec9-4da5-8362-b02e969545ea'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:02.641289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fbf782c7b5411b8ad3ec6122c98d6f', 'request_id': 'req-9794d903-cec9-4da5-8362-b02e969545ea'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:02.653378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] The token cache is being invalidate because project 42fbf782c7b5411b8ad3ec6122c98d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:02.653663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:02.654493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9794d903-cec9-4da5-8362-b02e969545ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:02.656108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 995/1983] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:02 2022] DELETE /identity/v3/projects/42fbf782c7b5411b8ad3ec6122c98d6f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:02.660971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:02.667342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:02.667342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:02.680891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:02.682118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:02.757985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:02.760521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 989/1984] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:02.768749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:02.769036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:02.769311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:02.797677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:02.798816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:02.815257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 996/1985] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:02.816640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:02.827998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f1812-c474-4c6f-b4e1-539a4af500ab None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:02.832817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:02.833952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:02.834181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:02.834439 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:02.835185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:02.835498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:02.837250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:02.852454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 990/1986] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:55:02.857258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:02.868460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208d74-0e77-46d7-9ad8-31693fe6cb5a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:02.873869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:02.874602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:02.874884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:02.875154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:02.875883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:02.877808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:02.972959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:02.997287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 997/1987] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:02 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:03.002106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:03.016857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776fad-92ef-4060-9cd4-a6ad70ed29f7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:03.080928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:03.081576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.081861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.082136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.083005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:03.085366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:03.198925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 991/1988] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:03 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:03.202920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:03.213846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1badc0a-1e03-4ec9-9d39-ddf5e70950d5 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:03.218378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:03.219037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.219317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.219641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.220402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:03.222007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:03.234222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 998/1989] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:03.241120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:03.250169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb2f8-faff-4736-8864-51a54c610afd admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:03.255413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:03.256134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.256444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.256723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.257463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:03.259071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ae64-8389-4051-aa5f-a4ae9b1ca9a1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:03.277383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 992/1990] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:03.281301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:03.292717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafa75e-4f26-41f3-a9c0-defc621233bc admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:03.297347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:03.298225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.298509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.298779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] PATH_INFO: `/v3/projects/246a899406c44cfda3cc3460346f02ed/users/9aaaefcafdc04d4eb7a8b3f8f657be94/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.314084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=246a899406c44cfda3cc3460346f02ed, user_id=9aaaefcafdc04d4eb7a8b3f8f657be94, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:03.316782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:03.413467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 999/1991] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:03 2022] PUT /identity/v3/projects/246a899406c44cfda3cc3460346f02ed/users/9aaaefcafdc04d4eb7a8b3f8f657be94/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:03.418745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.419033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.419311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.437548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:03.438886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:03.499423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 993/1992] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:03.510167 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:03.512434 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:03.572919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f624-e833-46bf-877f-331ba9025d5f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:03.576598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:03.577260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:03.577536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:03.577804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:03.587946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:03.589302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a435d94-9181-44e2-b883-5beb889dcba2 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:03.598919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1000/1993] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:03.879469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:04.422905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:04.424610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:04.437441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7315f62-5975-43c0-b673-fda14562b799 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:04.443650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:04.445520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:04.446224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:04.446397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] PATH_INFO: `/v3/users/dce603b4787d40c7bf4a64823cf9cae9` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:04.447906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce603b4787d40c7bf4a64823cf9cae9)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:04.450084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:04.653727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce603b4787d40c7bf4a64823cf9cae9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:04.654484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce603b4787d40c7bf4a64823cf9cae9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:04.668672 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce603b4787d40c7bf4a64823cf9cae9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:04.724621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:04.775950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce603b4787d40c7bf4a64823cf9cae9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:04.784153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce603b4787d40c7bf4a64823cf9cae9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:04.790816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 994/1994] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:04 2022] DELETE /identity/v3/users/dce603b4787d40c7bf4a64823cf9cae9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:04.795397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa48d3-9a66-4448-8671-d1952a5be2fc None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:04.795685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa48d3-9a66-4448-8671-d1952a5be2fc None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:04.796005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa48d3-9a66-4448-8671-d1952a5be2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:04.816809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-befa48d3-9a66-4448-8671-d1952a5be2fc None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:04.819173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-befa48d3-9a66-4448-8671-d1952a5be2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:04.886229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1001/1995] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:04.896550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:04.899269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:04.961630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc461c08-403c-4e4e-ba27-d24af173dfa8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:04.965481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:04.965820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:04.966114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:04.966404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:04.975913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:04.977352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:04.987398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 995/1996] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:55:05.030697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:05.031162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:05.031551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:05.062811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] MFA Rules not processed for user `9aaaefcafdc04d4eb7a8b3f8f657be94`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:05.064063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:05.154219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1002/1997] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:05.168288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:05.170146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:05.232205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be85363-9a9b-49c6-ae81-94d37054487c service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:05.236002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:05.236701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:05.237085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:05.237374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:05.247512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:05.249017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:05.259060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 996/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:55:05.328307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:05.577341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:05.579124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:05.601816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce443e-0bc3-4f01-99a1-f97e7a97f8d6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:05.606714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:05.607637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:05.607962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:05.608245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] PATH_INFO: `/v3/projects/29e2f253426641a490437edef1d1dd2b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:05.609583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e2f253426641a490437edef1d1dd2b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:05.611482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:05.648034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:05.745872 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e2f253426641a490437edef1d1dd2b', 'request_id': 'req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:05.812619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e2f253426641a490437edef1d1dd2b', 'request_id': 'req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:05.821238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e2f253426641a490437edef1d1dd2b', 'request_id': 'req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:05.835543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] The token cache is being invalidate because project 29e2f253426641a490437edef1d1dd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:05.835864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:05.836540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:05.838193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1003/1999] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:05 2022] DELETE /identity/v3/projects/29e2f253426641a490437edef1d1dd2b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:05.842138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:05.852953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f9e02-694d-4ab1-aa84-0e87f64f24f6 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:05.920102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:05.920984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:05.921262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:05.921532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] PATH_INFO: `/v3/users/acd944f35e5f4c3ca7c4232105ca0636` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:05.922730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd944f35e5f4c3ca7c4232105ca0636)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:05.924709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:06.244650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd944f35e5f4c3ca7c4232105ca0636'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:06.245354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd944f35e5f4c3ca7c4232105ca0636'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:06.258723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd944f35e5f4c3ca7c4232105ca0636'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:06.347216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd944f35e5f4c3ca7c4232105ca0636'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:06.355773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd944f35e5f4c3ca7c4232105ca0636'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:06.362352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 997/2000] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:05 2022] DELETE /identity/v3/users/acd944f35e5f4c3ca7c4232105ca0636 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:06.843560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:06.845514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:06.860418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e1ee-4ed2-4f24-97bc-07e243e2e9e3 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:06.929388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:06.930277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:06.930696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:06.931058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] PATH_INFO: `/v3/projects/5d3450e731f0430598ef55c7817a0024` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:06.932323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3450e731f0430598ef55c7817a0024)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:06.934362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:07.080409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3450e731f0430598ef55c7817a0024', 'request_id': 'req-482c665a-5bd3-4ea3-aa70-894db4957364'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.154890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3450e731f0430598ef55c7817a0024', 'request_id': 'req-482c665a-5bd3-4ea3-aa70-894db4957364'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.163009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3450e731f0430598ef55c7817a0024', 'request_id': 'req-482c665a-5bd3-4ea3-aa70-894db4957364'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.173548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] The token cache is being invalidate because project 5d3450e731f0430598ef55c7817a0024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:07.173830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.174477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.176069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1004/2001] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:06 2022] DELETE /identity/v3/projects/5d3450e731f0430598ef55c7817a0024 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:07.180271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:07.181725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:07.183830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:07.195200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa5a76-2615-4dd4-8fa4-8f62e8650e26 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:07.253645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:07.255173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:07.255512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:07.255881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] PATH_INFO: `/v3/users/2e28a02f1dcf40cca5397cf70578bbcc` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:07.258115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e28a02f1dcf40cca5397cf70578bbcc)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:07.259265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:07.454839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e28a02f1dcf40cca5397cf70578bbcc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.455495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e28a02f1dcf40cca5397cf70578bbcc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.468012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e28a02f1dcf40cca5397cf70578bbcc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.538520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e28a02f1dcf40cca5397cf70578bbcc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.541122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:07.547062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:07.547712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-330b2c1e-da60-401c-b529-0b04e2aa17eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e28a02f1dcf40cca5397cf70578bbcc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.548699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:07.554494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 998/2002] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:07 2022] DELETE /identity/v3/users/2e28a02f1dcf40cca5397cf70578bbcc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:07.562828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c665a-5bd3-4ea3-aa70-894db4957364 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:07.631238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:07.632344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:07.632609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:07.632883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] PATH_INFO: `/v3/users/a82d59b9b7b84103aa83e00b7230f818` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:07.634295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82d59b9b7b84103aa83e00b7230f818)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:07.636745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:07.866719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82d59b9b7b84103aa83e00b7230f818'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.873752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82d59b9b7b84103aa83e00b7230f818'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.874441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82d59b9b7b84103aa83e00b7230f818'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.888408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82d59b9b7b84103aa83e00b7230f818'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:07.889182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82d59b9b7b84103aa83e00b7230f818'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.010967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1005/2003] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:07 2022] DELETE /identity/v3/users/a82d59b9b7b84103aa83e00b7230f818 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:08.015644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.016018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.016353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.035346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:08.036750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.042995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.044448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.107507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 999/2004] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:08.118609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.120282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.139400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76d0c3-888b-4653-aee1-c15570ca7fb6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.146178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.147107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.147354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.147683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] PATH_INFO: `/v3/projects/b58574f302934120989464e2130eca77` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.149130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58574f302934120989464e2130eca77)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.151130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.186878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06a16-7028-4315-8c31-ba0815e80c65 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.190891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.191571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.191936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.192185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.201693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.203153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe8b92-0143-4cec-99e9-cae7617799fe service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.212904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1000/2005] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:55:08.214105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479403-f6c4-4ed9-bb51-0dfe2e6043e5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.214445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479403-f6c4-4ed9-bb51-0dfe2e6043e5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.214712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479403-f6c4-4ed9-bb51-0dfe2e6043e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.236461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ef479403-f6c4-4ed9-bb51-0dfe2e6043e5 None None] MFA Rules not processed for user `9aaaefcafdc04d4eb7a8b3f8f657be94`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:08.236461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ef479403-f6c4-4ed9-bb51-0dfe2e6043e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.276149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58574f302934120989464e2130eca77', 'request_id': 'req-efe2f159-d86a-4cdb-a930-ec0be2f84e18'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.294944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1001/2006] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:08.352754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58574f302934120989464e2130eca77', 'request_id': 'req-efe2f159-d86a-4cdb-a930-ec0be2f84e18'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.361521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58574f302934120989464e2130eca77', 'request_id': 'req-efe2f159-d86a-4cdb-a930-ec0be2f84e18'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.371570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] The token cache is being invalidate because project b58574f302934120989464e2130eca77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:08.371895 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.372565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-efe2f159-d86a-4cdb-a930-ec0be2f84e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:08.374152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1006/2007] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:08 2022] DELETE /identity/v3/projects/b58574f302934120989464e2130eca77 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:08.379774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.381294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.381736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.401215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:08.402712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.487774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1002/2008] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:08.496270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.496701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.497327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.517204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:08.518304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.528539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1007/2009] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:08.532862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.544915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bd719-ad6e-40f4-acd8-25b7081796f5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.549800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.550834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.550834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.551058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.551895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:08.552353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.553985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.569852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1003/2010] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:55:08.575157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.585133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f99f7a-e6e6-4f17-aae8-e3b6b2ded306 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.590123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.591033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.591153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.591420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.592185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.594109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.714878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.714878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:08.737602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1008/2011] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:08.746433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.747454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e6eb0-fde8-472a-bffc-f14c24d0ae1d admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.847210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d735-9355-4cca-bf07-59a210386213 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.853179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.853985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.854276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.854556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.855456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.857619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.866930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.868615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.869137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.869693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] PATH_INFO: `/v3/projects/9c7007aca50b4641b2651651e1d07923` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.871792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7007aca50b4641b2651651e1d07923)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.874849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:08.962846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1009/2012] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:08 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:55:08.965371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:08.976526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de3960-36b0-4a38-b648-7bca9a3a817b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:08.981951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:08.982652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:08.982933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:08.983208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:08.983981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:08.991249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:09.007140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1010/2013] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:09.008690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:09.012507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7007aca50b4641b2651651e1d07923', 'request_id': 'req-22fdd901-c793-47c0-ae3a-257a9f12d19a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.022526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a3dc-4afd-4aae-b09d-0d09b7ebaf59 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:09.083916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:09.097045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:09.098098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:09.099202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:09.099896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:09.100971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:09.103247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:09.115970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1011/2014] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:09.120371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:09.131692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428255-2f00-4b26-a102-113fb9e6e36a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:09.132606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7007aca50b4641b2651651e1d07923', 'request_id': 'req-22fdd901-c793-47c0-ae3a-257a9f12d19a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.138778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:09.140674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:09.140865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7007aca50b4641b2651651e1d07923', 'request_id': 'req-22fdd901-c793-47c0-ae3a-257a9f12d19a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.141085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:09.141572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] PATH_INFO: `/v3/projects/778940a5f3e843889349e1abb13c2d66/users/d8501dbb6a564e6bb68d81f4b9cccf01/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:09.157451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] The token cache is being invalidate because project 9c7007aca50b4641b2651651e1d07923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:09.158760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.158760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.164124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778940a5f3e843889349e1abb13c2d66, user_id=d8501dbb6a564e6bb68d81f4b9cccf01, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:09.164512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1004/2015] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:08 2022] DELETE /identity/v3/projects/9c7007aca50b4641b2651651e1d07923 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:09.165934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:09.167394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9214d0-5386-406c-bba5-dae9eb9070c4 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:09.167749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:09.181213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd901-c793-47c0-ae3a-257a9f12d19a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:09.186647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:09.187644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:09.189516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:09.189516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] PATH_INFO: `/v3/users/01ab590d5e574a4fac3d2f90a53e23f5` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:09.189683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ab590d5e574a4fac3d2f90a53e23f5)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:09.191575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:09.277143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1012/2016] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:09 2022] PUT /identity/v3/projects/778940a5f3e843889349e1abb13c2d66/users/d8501dbb6a564e6bb68d81f4b9cccf01/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:09.289380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:09.289668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:09.289941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:09.310156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:09.311674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:09.385712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1013/2017] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:09.392689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:09.394219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:09.413876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:09.435370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ab590d5e574a4fac3d2f90a53e23f5'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.436600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ab590d5e574a4fac3d2f90a53e23f5'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.453769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ab590d5e574a4fac3d2f90a53e23f5'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.486912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f3b4-43bb-47fa-a0b2-3362b94642ca None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:09.493507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:09.494688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:09.495201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:09.495719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:09.498359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:09.511597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:09.513087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:09.523692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1014/2018] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:55:09.553997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ab590d5e574a4fac3d2f90a53e23f5'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.564224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b7f33a96-5454-4ffe-bba6-95d039edeeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ab590d5e574a4fac3d2f90a53e23f5'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:09.573212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1005/2019] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:09 2022] DELETE /identity/v3/users/01ab590d5e574a4fac3d2f90a53e23f5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:10.131745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:10.133646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:10.152837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececec3-08f6-4412-a155-0648531d13d2 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:10.234358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:10.235594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.235940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.243984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] PATH_INFO: `/v3/projects/b912469909714c10b27763c3375fcd54` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.243984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b912469909714c10b27763c3375fcd54)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:10.243984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:10.262956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:10.395873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b912469909714c10b27763c3375fcd54', 'request_id': 'req-9766d651-f0a9-460f-9666-aa9dd106c522'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:10.486551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b912469909714c10b27763c3375fcd54', 'request_id': 'req-9766d651-f0a9-460f-9666-aa9dd106c522'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:10.493613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b912469909714c10b27763c3375fcd54', 'request_id': 'req-9766d651-f0a9-460f-9666-aa9dd106c522'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:10.504181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] The token cache is being invalidate because project b912469909714c10b27763c3375fcd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:10.505077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:10.505747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9766d651-f0a9-460f-9666-aa9dd106c522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:10.507720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1015/2020] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:10 2022] DELETE /identity/v3/projects/b912469909714c10b27763c3375fcd54 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:10.512585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.513092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.513188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.545601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:10.546883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:10.609878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1006/2021] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:10.618330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.618622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.618908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.637488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:10.638800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:10.647201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1016/2022] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:10.651630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:10.666395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc313c-7612-466f-a4b8-ae0b801648fd None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:10.666485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:10.667129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.667411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.667700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.668452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:10.668758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:10.670358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:10.683830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1007/2023] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:55:10.689486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:10.703024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623bcd-728a-4f31-96d7-1b97ba98f577 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:10.711162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:10.712251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.712708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.713155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.714319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:10.717911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:10.845523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1017/2024] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:10 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:55:10.846882 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:10.865438 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57dfd-1a4e-491e-afa2-330b24606ac6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:10.953481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:10.953481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:10.953481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:10.953481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:10.953787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:10.955742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:11.045012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1008/2025] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:10 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:11.049479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:11.060884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d9-6f40-4bda-bb1a-31438894be8b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:11.066410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:11.067115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:11.067614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:11.068027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:11.068922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:11.070647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:11.083036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1018/2026] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:11.088036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:11.099923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8b3ab-a98c-449f-a96b-4a5b37b864d5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:11.105141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:11.105848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:11.106130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:11.106404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:11.107137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:11.108768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad60d-cfa9-449b-ae66-db113d9c2e13 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:11.124183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1009/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:11.126348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:11.137551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0634-7a4d-4f4c-812f-01d525b2d240 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:11.142640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:11.268926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:11.268926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:11.268926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:11.268926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] PATH_INFO: `/v3/projects/c23100f2be894deebbcb2e876a57b3e5/users/c0c989d303324926a4a84245f98d5ba7/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:11.270912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23100f2be894deebbcb2e876a57b3e5, user_id=c0c989d303324926a4a84245f98d5ba7, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:11.270912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:11.742870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1019/2028] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:11 2022] PUT /identity/v3/projects/c23100f2be894deebbcb2e876a57b3e5/users/c0c989d303324926a4a84245f98d5ba7/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:11.757297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:11.758164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:11.758494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:11.789209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] MFA Rules not processed for user `c0c989d303324926a4a84245f98d5ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:11.790550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:11.864173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1010/2029] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:11.868639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:11.948040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715dd9-8d4d-48c1-8165-37df7b2ab3a6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:11.953680 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:11.954869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:11.955171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:11.955468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:11.956341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:11.959099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:11.977117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:12.070559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1020/2030] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:11 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:12.072708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.083017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b15c-9730-4b6d-86a5-8112a7eb4068 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.151667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.152403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.152695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.152969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.153732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.155798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:12.294204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1011/2031] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:12 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:12.298003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.322758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333688c-1631-4bf8-bca0-37facb356bc4 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.329433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.330794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.331092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.331371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.332476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.334312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:12.348458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1021/2032] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:12.353192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.372922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460cd3-c8ec-4a23-bedb-0052b122d910 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.373644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.374614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.374891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.375167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] PATH_INFO: `/v3/projects/dd1a9447865e4d3ea40bef19f32c9772/users/8a0dba92456441f6a82c60ec63e8d306/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.399434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1a9447865e4d3ea40bef19f32c9772, user_id=8a0dba92456441f6a82c60ec63e8d306, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.404312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:12.542967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1012/2033] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:12 2022] PUT /identity/v3/projects/dd1a9447865e4d3ea40bef19f32c9772/users/8a0dba92456441f6a82c60ec63e8d306/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:12.547219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.562676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52b5ff-963c-448a-bea9-2c52c40f94cc admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.639930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:12.645843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.646652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.647148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.647627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.648747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.650604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f0cd-05f3-425e-9a9d-59467c72e3d1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:12.667731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1022/2034] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:12.671879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.684398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a9262-ab79-4bfa-afef-47f50f9c4f68 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.689430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.690339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.690633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.690898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] PATH_INFO: `/v3/projects/dd1a9447865e4d3ea40bef19f32c9772/users/8a0dba92456441f6a82c60ec63e8d306/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.694369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1a9447865e4d3ea40bef19f32c9772, user_id=8a0dba92456441f6a82c60ec63e8d306, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.699317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:12.712535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1013/2035] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:12 2022] PUT /identity/v3/projects/dd1a9447865e4d3ea40bef19f32c9772/users/8a0dba92456441f6a82c60ec63e8d306/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:12.722756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.723486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.724265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.765433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] MFA Rules not processed for user `8a0dba92456441f6a82c60ec63e8d306`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:12.766689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:12.872154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1023/2036] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:12.889593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:12.894550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:12.969913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c81ed-d2f3-4818-a8c9-460baf1ad1b3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:12.978890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:12.979561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:12.980924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:12.981063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:12.993677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:12.998026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c426b5-e2e9-40d3-aeb6-fd90203ad8bd service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:13.024496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1014/2037] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:13.360053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:13.367473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:13.425459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e3e07-488d-42e9-bdee-19d67c00f340 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:13.440683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:13.443857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:13.445082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:13.445859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:13.514903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:13.542019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:13.543612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:13.563753 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1024/2038] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:13.677762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:14.950547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:14.991600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:15.742664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:15.795605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:16.803202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:17.831539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:18.323238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:18.323793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:18.323793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:18.385286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] MFA Rules not processed for user `d8501dbb6a564e6bb68d81f4b9cccf01`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:18.388361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:18.524564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1015/2039] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:18.526094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:18.528781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:18.594678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:18.625561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245c783-3bb1-4c3f-9a15-fccd37f99931 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:18.632251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:18.633148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:18.633513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:18.634035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:18.635154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:18.637270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:18.778134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1025/2040] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:18 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:18.782992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:18.800745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f755c-1c30-421e-a701-23c87eb19ca6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:18.889042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:18.891132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:18.891607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:18.892158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:18.893457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:18.897585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:19.005657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1016/2041] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:18 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:55:19.006846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:19.018517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4ecf-dc9e-4789-b7a9-f8e2dc98ba4c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:19.028285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:19.028987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:19.029276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:19.029951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:19.030991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:19.033247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:19.080203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1026/2042] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:19.088517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:19.107145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17872e2-60b0-465e-81fc-23372a4230f1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:19.141903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:19.142727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:19.143480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:19.143771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] PATH_INFO: `/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e/users/41fa37e21f4c49d4bf0f986e0e061e8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:19.169583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bad575bed754ca0bcf8b9c115e16e8e, user_id=41fa37e21f4c49d4bf0f986e0e061e8d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:19.178834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:19.285290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1017/2043] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:19 2022] PUT /identity/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e/users/41fa37e21f4c49d4bf0f986e0e061e8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:19.292050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:19.328900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccc5a-83b3-446e-aa34-8c430d98151c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:19.477296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:19.479071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:19.479923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:19.481449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:19.483107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:19.491533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:19.535880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1027/2044] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:19.543719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:19.580587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d25ca0-aa22-4944-9239-eb523961254c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:19.608029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:19.609739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:19.610340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:19.611617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] PATH_INFO: `/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e/users/41fa37e21f4c49d4bf0f986e0e061e8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:19.619309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bad575bed754ca0bcf8b9c115e16e8e, user_id=41fa37e21f4c49d4bf0f986e0e061e8d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:19.633653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06ee9-9584-4481-8fc4-248a88eb41ce admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:19.670124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1018/2045] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:19 2022] PUT /identity/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e/users/41fa37e21f4c49d4bf0f986e0e061e8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:20.328444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:20.446946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:22.006320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:22.027365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b0a2b-1e8e-4d6a-aa10-2f0294f4a65e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:22.169336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:22.171280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:22.172440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:22.173248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] PATH_INFO: `/v3/users/c0c989d303324926a4a84245f98d5ba7` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:22.176706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c989d303324926a4a84245f98d5ba7)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:22.182292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:22.509489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c989d303324926a4a84245f98d5ba7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:22.538369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c989d303324926a4a84245f98d5ba7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:22.542513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c989d303324926a4a84245f98d5ba7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:22.577609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c989d303324926a4a84245f98d5ba7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:22.579319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c989d303324926a4a84245f98d5ba7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:22.729217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1028/2046] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:22 2022] DELETE /identity/v3/users/c0c989d303324926a4a84245f98d5ba7 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:22.734837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69661-fde9-4628-bf3a-4d0693a42fd4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:22.735573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69661-fde9-4628-bf3a-4d0693a42fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:22.735573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69661-fde9-4628-bf3a-4d0693a42fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:22.782905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f1b69661-fde9-4628-bf3a-4d0693a42fd4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:22.785519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f1b69661-fde9-4628-bf3a-4d0693a42fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:22.830478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:22.904938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1019/2047] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:22.982329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:22.985625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:23.138843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770e60d-b744-4509-961f-2aa86aeae88e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:23.160561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:23.161649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:23.161941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:23.162415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:23.178293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:23.179877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194244a1-db2d-4fae-bc62-d5288534907f service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:23.197852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1029/2048] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:23.681217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:24.812378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:24.842488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:24.844786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:24.847058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:24.861575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1020/2049] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:55:24 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:55:24.910094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:24.912382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:24.912552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:24.939695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] MFA Rules not processed for user `af660e04a05a45cfa3db0713712ddc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:24.941309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:24.962668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:24.965993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:24.989347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:25.051213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4241-3ae8-4102-af92-f4fe7102b96d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:25.077648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:25.080126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:25.081227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:25.082677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] PATH_INFO: `/v3/projects/c23100f2be894deebbcb2e876a57b3e5` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:25.087550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23100f2be894deebbcb2e876a57b3e5)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:25.097196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:25.116211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1030/2050] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:25.145611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:25.149412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:25.201326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d8e2b-f77d-440e-b79f-3fc73d8ad04e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:25.226258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:25.231869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:25.232538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:25.233222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:25.256960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:25.262825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:25.329053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1031/2051] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:25.330878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:25.335456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:25.353679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23100f2be894deebbcb2e876a57b3e5', 'request_id': 'req-2adb060a-18ee-4745-9bb9-aa1ac789a86f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.400219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba63f70-88b8-4a27-b9bd-43b3eb9f7835 service placement] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:25.451753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23100f2be894deebbcb2e876a57b3e5', 'request_id': 'req-2adb060a-18ee-4745-9bb9-aa1ac789a86f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.473459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23100f2be894deebbcb2e876a57b3e5', 'request_id': 'req-2adb060a-18ee-4745-9bb9-aa1ac789a86f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.524489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] The token cache is being invalidate because project c23100f2be894deebbcb2e876a57b3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:25.527296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.531012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.539729 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1021/2052] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:24 2022] DELETE /identity/v3/projects/c23100f2be894deebbcb2e876a57b3e5 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:25.544356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:25.546175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:25.548125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:25.548620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:25.549261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:25.549812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] PATH_INFO: `/v3/users/5bce312f9f2747738555834e183097bc` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:25.552734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bce312f9f2747738555834e183097bc)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:25.557345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:25.595531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb060a-18ee-4745-9bb9-aa1ac789a86f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:25.612520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:25.614044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:25.614448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:25.614763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] PATH_INFO: `/v3/users/8a0dba92456441f6a82c60ec63e8d306` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:25.616428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0dba92456441f6a82c60ec63e8d306)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:25.618519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:25.833662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bce312f9f2747738555834e183097bc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.852329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bce312f9f2747738555834e183097bc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.853447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bce312f9f2747738555834e183097bc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.883553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bce312f9f2747738555834e183097bc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.884518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bce312f9f2747738555834e183097bc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.926865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0dba92456441f6a82c60ec63e8d306'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.928564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0dba92456441f6a82c60ec63e8d306'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.955461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0dba92456441f6a82c60ec63e8d306'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:25.981874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1032/2053] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:25 2022] DELETE /identity/v3/users/5bce312f9f2747738555834e183097bc => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:26.083629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0dba92456441f6a82c60ec63e8d306'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:26.112857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0dba92456441f6a82c60ec63e8d306'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:26.149129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1022/2054] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:25 2022] DELETE /identity/v3/users/8a0dba92456441f6a82c60ec63e8d306 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:26.678228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:26.681393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:26.919760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41eb2-99da-444d-b2a8-f0bbcd404414 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:26.975893 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:27.092168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:27.092998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:27.093283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:27.093563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] PATH_INFO: `/v3/projects/847c693005274d428b37d809e27cc2c9` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:27.096714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847c693005274d428b37d809e27cc2c9)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:27.097439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:27.120254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:27.241119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:27.245761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:27.282841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847c693005274d428b37d809e27cc2c9', 'request_id': 'req-56504d8c-0be1-4813-95e0-42187cd4a4f8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.306152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b78f7-d6a8-46a0-9b8e-19cc654d0330 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:27.384600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847c693005274d428b37d809e27cc2c9', 'request_id': 'req-56504d8c-0be1-4813-95e0-42187cd4a4f8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.402038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847c693005274d428b37d809e27cc2c9', 'request_id': 'req-56504d8c-0be1-4813-95e0-42187cd4a4f8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.432205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] The token cache is being invalidate because project 847c693005274d428b37d809e27cc2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:27.438215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.438487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:27.438691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.438830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:27.439162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:27.439915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] PATH_INFO: `/v3/projects/dd1a9447865e4d3ea40bef19f32c9772` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:27.442125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1a9447865e4d3ea40bef19f32c9772)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:27.443694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1033/2055] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:26 2022] DELETE /identity/v3/projects/847c693005274d428b37d809e27cc2c9 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:27.446801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:27.455166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:27.458195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:27.506130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504d8c-0be1-4813-95e0-42187cd4a4f8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:27.512668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:27.514003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:27.514337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:27.514656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] PATH_INFO: `/v3/users/c06ce9be336f409f911d5073a77ffe71` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:27.516385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06ce9be336f409f911d5073a77ffe71)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:27.519766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:27.668607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1a9447865e4d3ea40bef19f32c9772', 'request_id': 'req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.776196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06ce9be336f409f911d5073a77ffe71'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.776639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1a9447865e4d3ea40bef19f32c9772', 'request_id': 'req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.796960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06ce9be336f409f911d5073a77ffe71'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.799556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1a9447865e4d3ea40bef19f32c9772', 'request_id': 'req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.800601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06ce9be336f409f911d5073a77ffe71'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.830879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] The token cache is being invalidate because project dd1a9447865e4d3ea40bef19f32c9772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:27.831414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.834423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9e77b4b7-328b-420d-86d3-fd0b7dd2d90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.838033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1023/2056] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:27 2022] DELETE /identity/v3/projects/dd1a9447865e4d3ea40bef19f32c9772 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:27.847119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06ce9be336f409f911d5073a77ffe71'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.849592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-006ede55-eeb8-4886-8b84-74a5322ff7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06ce9be336f409f911d5073a77ffe71'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:27.850518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:27.851195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:27.851891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:27.931414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:27.933088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:27.993133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1034/2057] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:27 2022] DELETE /identity/v3/users/c06ce9be336f409f911d5073a77ffe71 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:28.074829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:28.132347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1024/2058] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:28.140612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.141157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.141533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.186412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:28.188592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:28.294578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1035/2059] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:28.295790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.311652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441da6e-a04b-4d1b-9f54-944b1769b873 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.320827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.321534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.321962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.322191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.322975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:28.323279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.324984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.340846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1025/2060] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:55:28.346441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.365162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1b751-bcf2-4e25-adcd-6077041c0096 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.372154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.372839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.373120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.373395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.374127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.376072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.517264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1036/2061] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:28 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:28.519190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.556897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e855e0-58e8-48a1-bdbb-dae7fc55fb17 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.593249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:28.631582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.634123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:28.658987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.659675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.660008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.660995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.661915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.685275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.817602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1026/2062] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:28 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:28.824219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.857710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ed341-b706-496d-8031-02ca953715d4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.868234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.868941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.869225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.869502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.870271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.872197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.881894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917e4a-203f-4789-a88a-285cbf3259ab admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.887371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1027/2063] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:28.891651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.893427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.896404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.897146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.898232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] PATH_INFO: `/v3/projects/2efb2b9bad814778aa430ec2d8bee984` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.902666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efb2b9bad814778aa430ec2d8bee984)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.903758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945749-851d-4c69-b5b4-859247248d0c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.907592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.910015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.911388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.911676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.912009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.912768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.914569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:28.932380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1028/2064] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:28.933524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:28.945687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7487aa4-a06b-41be-971c-c77456a425a8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:28.951404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:28.952629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:28.952920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:28.953198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] PATH_INFO: `/v3/projects/ea1efa7c5e1045cd8902a7f4f3d1b00b/users/4f3f19ea1c464027802890a15239c5d0/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:28.974498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1efa7c5e1045cd8902a7f4f3d1b00b, user_id=4f3f19ea1c464027802890a15239c5d0, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:28.977653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22b43f-cb56-421f-b7c3-75c10fe846cd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:29.090734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1029/2065] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:28 2022] PUT /identity/v3/projects/ea1efa7c5e1045cd8902a7f4f3d1b00b/users/4f3f19ea1c464027802890a15239c5d0/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:29.108746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.109253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.109735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.154347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efb2b9bad814778aa430ec2d8bee984', 'request_id': 'req-2e2c3fcb-c428-4d30-ab91-a893afc53bff'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:29.172134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] MFA Rules not processed for user `4f3f19ea1c464027802890a15239c5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:29.173421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:29.273241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efb2b9bad814778aa430ec2d8bee984', 'request_id': 'req-2e2c3fcb-c428-4d30-ab91-a893afc53bff'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:29.294284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efb2b9bad814778aa430ec2d8bee984', 'request_id': 'req-2e2c3fcb-c428-4d30-ab91-a893afc53bff'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:29.340013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] The token cache is being invalidate because project 2efb2b9bad814778aa430ec2d8bee984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:29.340489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:29.343710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2e2c3fcb-c428-4d30-ab91-a893afc53bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:29.368113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1037/2066] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:28 2022] DELETE /identity/v3/projects/2efb2b9bad814778aa430ec2d8bee984 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:55:29.371084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54b4e-e91b-4299-8e7c-a063c55c0c6a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.371491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54b4e-e91b-4299-8e7c-a063c55c0c6a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.384691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1030/2067] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:29.384777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54b4e-e91b-4299-8e7c-a063c55c0c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.396857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:29.468996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b0c54b4e-e91b-4299-8e7c-a063c55c0c6a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:29.481003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b0c54b4e-e91b-4299-8e7c-a063c55c0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:29.610455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fd48-4a05-4f79-91cf-c0b195da5f02 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:29.622480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:29.623347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.628807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.628807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.628807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:29.632467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:29.727676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1038/2068] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:29.736451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.736451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.736776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.776515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:29.777770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:29.791963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1031/2069] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/projects => generated 385 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:29.795100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1039/2070] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:29.797889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:29.800803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:29.802867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:29.813243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cea9d-98f2-41e3-bdbf-50071b73b561 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:29.927224 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:29.927967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.928255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.928547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.929465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:29.929774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:29.931467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:29.956120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1040/2071] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:55:29.959589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:29.970458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd03d-56bc-42f3-a276-449f79e15ccc admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:29.981790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:29.982603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.982950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.983289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.984248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:29.987110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:29.989201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22bb9-b2b9-48fc-b5ce-9fb3a649eda7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:29.996194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:29.996869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:29.997785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:29.997941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:29.999429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.004639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.024036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:30.133167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1032/2072] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:30.140015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.155695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade1e9-32a1-43f6-96e8-2bb88e66d3d3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.171683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.172517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.173060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.173060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.173882 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.175514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.192359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1033/2073] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:30.193757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1041/2074] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:29 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:30.200837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.201283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.228086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9390-ca5a-4a8e-a4e9-7d6a0afec5e0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.423760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.425222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.425797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.426847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] PATH_INFO: `/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8/users/ede39a046e8a480eae7986d3dfe37e4c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.455446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb212726ca5a44ae94f6e9fc9d8b5ba8, user_id=ede39a046e8a480eae7986d3dfe37e4c, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.459713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.466648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:30.488975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb0a8d-8f96-4841-957e-ec29b8db2479 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.559002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.559002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.559002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.559408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.560352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.563066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.590236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1034/2075] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:30 2022] PUT /identity/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8/users/ede39a046e8a480eae7986d3dfe37e4c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:30.594494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.704952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1042/2076] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:30 2022] POST /identity/v3/users => generated 286 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:30.710272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.729646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442fac6-110f-44a4-bb17-26040b3a97db admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.792191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a11f4-cef7-4d77-b36d-84b8c1a586b1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.800176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.801838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.805895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.806294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.807163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.811922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dc7ac-466a-408a-8d1a-094ad297111c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.821565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.822836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.823321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.823656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.824687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.829198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.829850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1035/2077] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:30.831539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a32af-33ee-4c3d-bcb1-301d0b108898 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.832077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a32af-33ee-4c3d-bcb1-301d0b108898 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.840800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a32af-33ee-4c3d-bcb1-301d0b108898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.845345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1043/2078] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:30.846225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.857812 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a598-dc0d-47a9-9825-f6c9333a7b5c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:30.865383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:30.866264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.869411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.869411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] PATH_INFO: `/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8/users/ede39a046e8a480eae7986d3dfe37e4c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:30.869411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb212726ca5a44ae94f6e9fc9d8b5ba8, user_id=ede39a046e8a480eae7986d3dfe37e4c, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:30.871974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:30.875607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5d3a32af-33ee-4c3d-bcb1-301d0b108898 None None] MFA Rules not processed for user `41fa37e21f4c49d4bf0f986e0e061e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:30.876901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5d3a32af-33ee-4c3d-bcb1-301d0b108898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:30.890813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1044/2079] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:30 2022] PUT /identity/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8/users/ede39a046e8a480eae7986d3dfe37e4c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:30.891566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:30.990937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1036/2080] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:30.992863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:30.993766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:30.994198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.001556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bbdfe-cce6-43fc-b43f-4f41b3eff373 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.014608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.015275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.015842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.015982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.016751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.018662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:31.031378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1045/2081] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:31.031692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:31.041027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:31.047236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] MFA Rules not processed for user `ede39a046e8a480eae7986d3dfe37e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:31.049738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.057332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.168047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1037/2082] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:31.169528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:31.187456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b22af-90dc-4ec3-9355-2b4e6ede1bc0 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.194297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.198524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.198524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.198524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] PATH_INFO: `/v3/projects/33fa7e79130f46cb800e297f7b874cb0/users/ce67abd18aa14b73bcf280e329d92e9d/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.198813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405913b-bbd4-45c4-a159-0caf0ff3aa40 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.208142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.208948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.209476 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.209975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.212584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.220458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa7e79130f46cb800e297f7b874cb0, user_id=ce67abd18aa14b73bcf280e329d92e9d, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.224824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e39a5-daee-4d87-9e12-de45f1948603 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:31.283774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.286915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:31.299266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1046/2083] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:31.300461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:31.307513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.309007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1038/2084] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:31 2022] PUT /identity/v3/projects/33fa7e79130f46cb800e297f7b874cb0/users/ce67abd18aa14b73bcf280e329d92e9d/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:31.321059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207662cf-d885-4541-9404-17a93fe399cb None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.321749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207662cf-d885-4541-9404-17a93fe399cb None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.322413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207662cf-d885-4541-9404-17a93fe399cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.359744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-207662cf-d885-4541-9404-17a93fe399cb None None] MFA Rules not processed for user `ce67abd18aa14b73bcf280e329d92e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:31.361407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-207662cf-d885-4541-9404-17a93fe399cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.388749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ccb11-9704-4a5e-8b1b-06c08a2c855c service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.459903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.464117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.464117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.464117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.490997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1039/2085] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:31.499471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207662cf-d885-4541-9404-17a93fe399cb None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:31.502540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-207662cf-d885-4541-9404-17a93fe399cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:31.534939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207662cf-d885-4541-9404-17a93fe399cb None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.541087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.545636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.546079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.546630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.581407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.588497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:31.601188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.605417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368166-b0f1-478f-a81a-f6e2f5028d59 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:31.610675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1040/2086] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:31.632228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:31.635144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1047/2087] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:31.765312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697753e-8581-4be5-8141-6811b210e1c3 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:31.774141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:31.775278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:31.775906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:31.776279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] PATH_INFO: `/v3/users/ce67abd18aa14b73bcf280e329d92e9d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:31.777972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce67abd18aa14b73bcf280e329d92e9d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:31.780982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:32.038847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:32.119840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce67abd18aa14b73bcf280e329d92e9d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:32.120730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce67abd18aa14b73bcf280e329d92e9d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:32.143902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce67abd18aa14b73bcf280e329d92e9d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:32.226033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce67abd18aa14b73bcf280e329d92e9d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:32.241959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce67abd18aa14b73bcf280e329d92e9d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:32.256966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1041/2088] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:31 2022] DELETE /identity/v3/users/ce67abd18aa14b73bcf280e329d92e9d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:32.268356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:32.268921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:32.268921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:32.312227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:32.315299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:32.402866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1048/2089] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:32.427085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:32.429639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:32.516070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8922-73df-40ce-9b23-409a00ba0e66 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:32.533610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:32.534694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:32.535316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:32.535819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:32.549500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:32.551716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:32.568176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1042/2090] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:32.819009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:33.338006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:33.339607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:33.362668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de9cef-8117-44c4-8e3c-09168d9b9c98 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:33.368784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:33.370580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:33.371187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:33.371646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] PATH_INFO: `/v3/projects/33fa7e79130f46cb800e297f7b874cb0` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:33.373606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa7e79130f46cb800e297f7b874cb0)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:33.376083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:33.489218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:33.491046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:33.528228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e423-616d-4473-989d-9d835dea4a6e service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:33.542950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa7e79130f46cb800e297f7b874cb0', 'request_id': 'req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.609844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa7e79130f46cb800e297f7b874cb0', 'request_id': 'req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.619911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa7e79130f46cb800e297f7b874cb0', 'request_id': 'req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.653450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:33.656701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:33.656867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] The token cache is being invalidate because project 33fa7e79130f46cb800e297f7b874cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:33.657102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.661067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:33.661351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] PATH_INFO: `/v3/users/4f3f19ea1c464027802890a15239c5d0` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:33.664880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3f19ea1c464027802890a15239c5d0)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:33.666023 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3f97bc06-7bad-45da-8b4f-ff3390a3ff1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.669326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:33.677687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1049/2091] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:33 2022] DELETE /identity/v3/projects/33fa7e79130f46cb800e297f7b874cb0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:33.683445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720387b-a4c7-4ca3-a82f-bd74c5e23ee5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:33.683972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720387b-a4c7-4ca3-a82f-bd74c5e23ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:33.684581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720387b-a4c7-4ca3-a82f-bd74c5e23ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:33.693813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:33.723898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-5720387b-a4c7-4ca3-a82f-bd74c5e23ee5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:33.725362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5720387b-a4c7-4ca3-a82f-bd74c5e23ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:33.751444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1050/2092] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:33.759936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:33.761505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:33.761505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:33.792418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:33.793645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:33.822296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1051/2093] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:33.827398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:33.890991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1e66-3384-4e45-bd0e-6ff896a5630d None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:33.909111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:33.909878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:33.910481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:33.910904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:33.912534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:33.912845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:33.915223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:33.963727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1052/2094] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 14:55:33.964530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:33.973283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3f19ea1c464027802890a15239c5d0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:33.976336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3f19ea1c464027802890a15239c5d0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:34.020384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ddf54-fc48-449e-b5f5-2a0c5cb08dc2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.024542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3f19ea1c464027802890a15239c5d0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:34.033306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.034030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.034312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.034585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.035543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.037940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.144305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3f19ea1c464027802890a15239c5d0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:34.159642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-b13865bc-b9ff-4f78-a4da-b1ecb8c86cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3f19ea1c464027802890a15239c5d0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:34.181180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1043/2095] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:33 2022] DELETE /identity/v3/users/4f3f19ea1c464027802890a15239c5d0 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:34.188068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.188591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.189285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.233094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1053/2096] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:33 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:34.237708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:34.241839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:34.252655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:34.254690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:34.420223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27d78-ab1c-43c9-a6d2-19383032f61c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.421063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1044/2097] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:34.429570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.430813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.431763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:34.432215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.433017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.433199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:34.434520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.437771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.584904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4cc6-e84c-4a53-8989-1c87067896c4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.599344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.600065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.600348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.604999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.615511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1054/2098] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:34 2022] POST /identity/v3/users => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:34.624153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:34.627441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.632114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.670162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeb4e-eb75-44e7-ae30-6863edaee039 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.683215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1045/2099] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:55:34.685285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.686423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.686857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.687278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.693176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.695266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.721863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1055/2100] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:34.731844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:34.736969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe52fb-684d-4a1b-9593-5f3a1026965f service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.754855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.756358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.756775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.763211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.763211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.763211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d56c0-b8ce-4ba7-bb16-634b6e023717 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.782109 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1046/2101] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:34.783398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:34.798994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d77f9-9fd8-47a9-84a7-6a78fa858008 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:34.818280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:34.819689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.820336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.820816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] PATH_INFO: `/v3/projects/0d6b2286d74247feb88e6375e081457d/users/af6f3c897cff4e24bb704ad9e6583cfe/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:34.857857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:34.872178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6b2286d74247feb88e6375e081457d, user_id=af6f3c897cff4e24bb704ad9e6583cfe, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:34.876389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:34.920855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:34.961454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1056/2102] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:34 2022] PUT /identity/v3/projects/0d6b2286d74247feb88e6375e081457d/users/af6f3c897cff4e24bb704ad9e6583cfe/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:34.982330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:34.983160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:34.984161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:35.034155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] MFA Rules not processed for user `af6f3c897cff4e24bb704ad9e6583cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:35.036905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:35.186612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1047/2103] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:35.195579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:35.198288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:35.320390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0423-87a3-4295-a69c-b0613cbbc9f7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:35.331271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:35.332500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:35.332851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:35.333235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:35.346387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:35.349621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ace82-26dd-4df5-b5b7-4bed8c98c57e service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:35.367126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1057/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:35.499992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:35.499992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:35.504879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:35.505478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:35.505478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:35.543368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] MFA Rules not processed for user `d8501dbb6a564e6bb68d81f4b9cccf01`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:35.544650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:35.632217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4bcf6-6e10-4595-9c6b-43ec6d9e7884 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:35.644995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:35.646151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:35.646601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:35.646881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] PATH_INFO: `/v3/projects/ea1efa7c5e1045cd8902a7f4f3d1b00b` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:35.654943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1efa7c5e1045cd8902a7f4f3d1b00b)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:35.660619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1058/2105] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:35.674724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:35.849389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1efa7c5e1045cd8902a7f4f3d1b00b', 'request_id': 'req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:35.989644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1efa7c5e1045cd8902a7f4f3d1b00b', 'request_id': 'req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.001747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1efa7c5e1045cd8902a7f4f3d1b00b', 'request_id': 'req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.009545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] The token cache is being invalidate because project ea1efa7c5e1045cd8902a7f4f3d1b00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:36.009952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.010814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.012651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1048/2106] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:35 2022] DELETE /identity/v3/projects/ea1efa7c5e1045cd8902a7f4f3d1b00b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:36.016806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:36.029728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92031b-e3e1-4726-8c65-18cd6237ccf1 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:36.097181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:36.098717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:36.098996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:36.099264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] PATH_INFO: `/v3/users/ede39a046e8a480eae7986d3dfe37e4c` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:36.100733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede39a046e8a480eae7986d3dfe37e4c)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:36.102802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:36.386869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede39a046e8a480eae7986d3dfe37e4c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.393727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede39a046e8a480eae7986d3dfe37e4c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.394932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede39a046e8a480eae7986d3dfe37e4c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.406862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede39a046e8a480eae7986d3dfe37e4c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.407556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-02dd4543-9469-4410-aad3-06ecc6f8ea58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede39a046e8a480eae7986d3dfe37e4c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:36.502878 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1059/2107] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:36 2022] DELETE /identity/v3/users/ede39a046e8a480eae7986d3dfe37e4c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:36.827678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:36.966225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:36.967685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:36.981269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0bd0-3f67-4c7b-8525-3d21c1746aff admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:37.074258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:37.075132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.075414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.075687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] PATH_INFO: `/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.076948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb212726ca5a44ae94f6e9fc9d8b5ba8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:37.079367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:37.222262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb212726ca5a44ae94f6e9fc9d8b5ba8', 'request_id': 'req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:37.286543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb212726ca5a44ae94f6e9fc9d8b5ba8', 'request_id': 'req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:37.293869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb212726ca5a44ae94f6e9fc9d8b5ba8', 'request_id': 'req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:37.304974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] The token cache is being invalidate because project bb212726ca5a44ae94f6e9fc9d8b5ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:37.305258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:37.305916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-66bbb4d8-6ea1-4d12-abfe-b6a9df880017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:37.307501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1049/2108] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:36 2022] DELETE /identity/v3/projects/bb212726ca5a44ae94f6e9fc9d8b5ba8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:37.313665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.314530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.314816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.344208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:37.345418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:37.418755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1060/2109] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:37.427973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.428322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.428598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.441955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:37.460527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:37.461781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:37.473361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1050/2110] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:37.478153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:37.489047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41ce15-f60a-4136-89f7-3bb36ff9e431 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:37.494855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:37.495564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.496091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.496606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.512563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:37.512951 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:37.515408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:37.533756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1061/2111] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:55:37.541304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:37.553360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497172bb-cbfc-408b-ab01-54e07f6f597e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:37.559482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:37.560097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.567235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.567235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.567235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:37.567235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:37.702179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1051/2112] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:37 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:37.704967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:37.720698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfc4aa-cc44-4a18-8995-f52da6264ba8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:37.846347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:37.847576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.848618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.849130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.851498 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:37.856972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:37.964239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1062/2113] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:37 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:37.968704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:37.983127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914cdf-ee4e-4b02-83ca-5006805f02fd admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:37.988859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:37.989668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:37.990250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:37.990592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:37.991565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:37.993408 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:38.010884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1052/2114] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:38.013075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:38.030063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c6e6-59fe-43f5-9592-38b113517fe6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:38.035050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:38.035925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:38.036220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:38.037431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:38.038493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:38.040999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0d51-6cd8-4bff-9206-af7bc8934bb7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:38.052630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1063/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:38.058195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:38.069769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc995d55-6c87-4703-9348-9df66d7eec9a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:38.074682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:38.075595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:38.075907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:38.076211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] PATH_INFO: `/v3/projects/cbf4b3b313fa4ebeadc94cb6e340c585/users/3b784008a1ec4857b6d12acd789a9902/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:38.093865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf4b3b313fa4ebeadc94cb6e340c585, user_id=3b784008a1ec4857b6d12acd789a9902, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:38.096714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cbc98-5f83-4bdb-be66-caeb89c70812 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:38.253919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:38.254236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:38.254588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:38.286581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] MFA Rules not processed for user `9aaaefcafdc04d4eb7a8b3f8f657be94`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:38.286581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:38.314794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1053/2116] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:38 2022] PUT /identity/v3/projects/cbf4b3b313fa4ebeadc94cb6e340c585/users/3b784008a1ec4857b6d12acd789a9902/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:38.330101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03b0a-089a-4155-b433-f52cf24885d7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:38.330483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03b0a-089a-4155-b433-f52cf24885d7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:38.330767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03b0a-089a-4155-b433-f52cf24885d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:38.350329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1064/2117] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:38.374706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5aa03b0a-089a-4155-b433-f52cf24885d7 None None] MFA Rules not processed for user `3b784008a1ec4857b6d12acd789a9902`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:38.376152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5aa03b0a-089a-4155-b433-f52cf24885d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:38.451694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1054/2118] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:38.464665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:38.467025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:38.486379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:38.536963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cab1-215a-4d2c-bcc4-50567e44f259 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:38.590319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:38.591030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:38.591310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:38.591585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:38.601870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:38.603828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:38.614133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1065/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:38.698126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:38.903448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.913039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:40.246184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:40.706914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:40.846244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2dfc-8324-43db-99bb-b9575db44e79 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:40.846574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2dfc-8324-43db-99bb-b9575db44e79 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:40.846851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2dfc-8324-43db-99bb-b9575db44e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:40.870017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-07ce2dfc-8324-43db-99bb-b9575db44e79 None None] MFA Rules not processed for user `94374d8e4dfc4cd5aa0f55bedaf590c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:40.871361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-07ce2dfc-8324-43db-99bb-b9575db44e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:40.939099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1055/2120] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:40.998451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:41.206624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:41.513104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:41.543141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:41.861032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:42.023497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:42.369914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:51.695038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=41 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:52.549991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=2,keystone:SELECT=87,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:54.764947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:54.858172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254e08-b517-4ffa-b7b0-2dbc5c105837 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:54.862709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:54.864291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:54.864576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:54.864848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] PATH_INFO: `/v3/users/3b784008a1ec4857b6d12acd789a9902` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:54.866039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b784008a1ec4857b6d12acd789a9902)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:54.868038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:55.060917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b784008a1ec4857b6d12acd789a9902'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:55.068146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b784008a1ec4857b6d12acd789a9902'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:55.068827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b784008a1ec4857b6d12acd789a9902'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:55.083516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b784008a1ec4857b6d12acd789a9902'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:55.084282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b784008a1ec4857b6d12acd789a9902'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:55.176432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1066/2121] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:55:54 2022] DELETE /identity/v3/users/3b784008a1ec4857b6d12acd789a9902 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:55.178662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:55.179111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:55.179200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:55.198239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:55.199455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:55.266606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1056/2122] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:55.279464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:55.281105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:55.347297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d393e-fff5-491a-8463-c9bea53a4a4d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:55.351143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:55.354879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:55.354879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:55.354879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:55.362516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:55.364204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fb434-91c5-47a1-9bc2-feed72257bed service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:55.375762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1067/2123] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:55:55.881876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:55.883523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:55.902854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60668-7bde-4d6d-b6da-ce749f589472 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:55.910954 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:55.914301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:55.914301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:55.914301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] PATH_INFO: `/v3/projects/cbf4b3b313fa4ebeadc94cb6e340c585` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:55.914301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf4b3b313fa4ebeadc94cb6e340c585)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:55.916415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.064483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf4b3b313fa4ebeadc94cb6e340c585', 'request_id': 'req-eede8f75-0cb5-4e21-8446-fb08ffe3d725'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:56.160275 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf4b3b313fa4ebeadc94cb6e340c585', 'request_id': 'req-eede8f75-0cb5-4e21-8446-fb08ffe3d725'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:56.167980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf4b3b313fa4ebeadc94cb6e340c585', 'request_id': 'req-eede8f75-0cb5-4e21-8446-fb08ffe3d725'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:56.180663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] The token cache is being invalidate because project cbf4b3b313fa4ebeadc94cb6e340c585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:55:56.181338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:56.181793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-eede8f75-0cb5-4e21-8446-fb08ffe3d725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:55:56.183533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1057/2124] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:55:55 2022] DELETE /identity/v3/projects/cbf4b3b313fa4ebeadc94cb6e340c585 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:56.189643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.190155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.190267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.195981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:56.234530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:56.235776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:56.314409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1068/2125] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:56.323791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.324117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.324365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.344451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:56.345665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:56.354288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1058/2126] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:55:56.358701 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.369359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a316a86-101c-414c-8db5-f9b6198a817f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.373897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.374558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.374836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.375110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.375900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:55:56.376206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.377892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.391721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1069/2127] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:55:56.397347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.407717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cc726-1af0-443c-b2b6-2842e6b9c5cd None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.413489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.414097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.414387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.414660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.415362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.417308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.522878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1059/2128] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:55:56 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:56.527330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.538669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf4e-3344-44fc-9e38-1d895bfbbb3e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.618353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.618983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.619470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.619942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.620286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.622292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.738834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1070/2129] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:55:56 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:55:56.743527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.754751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1904b-b203-4779-83d9-6b2e6ee5de84 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.759475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.760181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.760464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.760762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.761490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.763090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.774228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1060/2130] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:55:56.786577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.792539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a8d4-0931-46c5-bd1e-0a3d42d72f7d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.814703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.815558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.816648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.817165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.818575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.833233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0efa8b-88bb-4954-9861-3f7e9b8e708e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:56.858063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1071/2131] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:55:56.867375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:56.910054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cb3a-550e-48ea-9978-cab444d1ac26 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:56.918589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:56.920730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:56.921673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:56.922165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] PATH_INFO: `/v3/projects/30ba3027dfb74db6aabbabe4b57609a3/users/17432fd713ed455296e8af50fa4e1b52/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:56.964764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba3027dfb74db6aabbabe4b57609a3, user_id=17432fd713ed455296e8af50fa4e1b52, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:56.970000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:57.061985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1061/2132] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:55:56 2022] PUT /identity/v3/projects/30ba3027dfb74db6aabbabe4b57609a3/users/17432fd713ed455296e8af50fa4e1b52/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:55:57.074607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e56ae-7c1f-4b33-81d3-b6c60c24322f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:57.075414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e56ae-7c1f-4b33-81d3-b6c60c24322f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:57.076060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e56ae-7c1f-4b33-81d3-b6c60c24322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:57.119105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f78e56ae-7c1f-4b33-81d3-b6c60c24322f None None] MFA Rules not processed for user `17432fd713ed455296e8af50fa4e1b52`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:55:57.121307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f78e56ae-7c1f-4b33-81d3-b6c60c24322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:57.194245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:57.223439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1072/2133] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:55:57.238011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:55:57.241110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:55:57.287604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:57.337059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613012-a7f6-4fbd-a093-cace458c2fd4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:55:57.341976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:55:57.342809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:55:57.343172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:55:57.343522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:55:57.370489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:55:57.372695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f384f-eb02-4d3b-aaec-8be556aed1a7 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:55:57.386852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1062/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:56:00.408589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:00.409399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:00.409399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:00.446134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] MFA Rules not processed for user `17432fd713ed455296e8af50fa4e1b52`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:00.447942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:00.466648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1073/2135] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:03.408423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad68b-e2d5-4a2d-b265-0b1f3fdf44d2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:03.409295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad68b-e2d5-4a2d-b265-0b1f3fdf44d2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:03.409295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad68b-e2d5-4a2d-b265-0b1f3fdf44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:03.434433 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-627ad68b-e2d5-4a2d-b265-0b1f3fdf44d2 None None] MFA Rules not processed for user `10942dbd553e44dcb49a48de4dd65d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:03.435990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-627ad68b-e2d5-4a2d-b265-0b1f3fdf44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:03.513793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1063/2136] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:04.333572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:04.335106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:04.440582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a2f0c-2cf6-4666-87f6-6e350a417e78 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:04.446691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:04.452822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:04.452822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:04.452822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] PATH_INFO: `/v3/users/af6f3c897cff4e24bb704ad9e6583cfe` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:04.452822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6f3c897cff4e24bb704ad9e6583cfe)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:04.452822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:04.759314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6f3c897cff4e24bb704ad9e6583cfe'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:04.767959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6f3c897cff4e24bb704ad9e6583cfe'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:04.768790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6f3c897cff4e24bb704ad9e6583cfe'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:04.784572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6f3c897cff4e24bb704ad9e6583cfe'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:04.785317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6f3c897cff4e24bb704ad9e6583cfe'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:04.861235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1074/2137] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:56:04 2022] DELETE /identity/v3/users/af6f3c897cff4e24bb704ad9e6583cfe => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:56:04.866066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42066e8-4738-415e-8448-641448703e28 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:04.866590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42066e8-4738-415e-8448-641448703e28 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:04.866697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42066e8-4738-415e-8448-641448703e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:04.885818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e42066e8-4738-415e-8448-641448703e28 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:04.887184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e42066e8-4738-415e-8448-641448703e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:04.958374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1064/2138] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:04.968907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:04.970645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:05.047765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccdf3d-4c21-45c9-8c0d-ae3a2f34b8fe admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:05.052003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:05.057396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:05.057396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:05.057396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:05.064459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:05.066495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90c0ad-9a3a-44e6-a7cc-8dde585ad9d1 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:05.071249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:05.079721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1075/2139] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:56:06.163629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42066e8-4738-415e-8448-641448703e28 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:06.169000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e42066e8-4738-415e-8448-641448703e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:06.184069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42066e8-4738-415e-8448-641448703e28 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:06.191618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:06.193386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:06.193738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:06.194104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] PATH_INFO: `/v3/projects/0d6b2286d74247feb88e6375e081457d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:06.195500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6b2286d74247feb88e6375e081457d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:06.197572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:06.411445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6b2286d74247feb88e6375e081457d', 'request_id': 'req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:06.520138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6b2286d74247feb88e6375e081457d', 'request_id': 'req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:06.529652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6b2286d74247feb88e6375e081457d', 'request_id': 'req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:06.532382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:06.555290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] The token cache is being invalidate because project 0d6b2286d74247feb88e6375e081457d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:56:06.555769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:06.557138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-34d4f282-c1e0-49ea-a3ca-f93b9feee0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:06.559455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1065/2140] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:56:06 2022] DELETE /identity/v3/projects/0d6b2286d74247feb88e6375e081457d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:56:06.566478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:06.567072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:06.567072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:06.590016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:06.591590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:06.726344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1076/2141] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:06.727638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:06.728194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:06.731386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:06.765913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:06.767172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:06.778856 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1066/2142] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:06.783338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:06.801343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711288cb-9561-4988-a9d2-90b498a85a37 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:06.811549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:06.812420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:06.813166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:06.815303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:06.815303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:56:06.815303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:06.824546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:06.849338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1077/2143] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:56:06.853666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:06.866607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e7b0b-4cca-460d-a55a-04a6e5ae337c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:06.876777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:06.877897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:06.879206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:06.879697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:06.880689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:06.882887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.022850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1067/2144] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:56:06 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:56:07.024455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:07.042062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043101-27a8-4d65-87df-a402ecf3449f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:07.106277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:07.106953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.107299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.107570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.108333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:07.110313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.228384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:07.228904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1078/2145] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:56:07 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:56:07.241346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b55e-6258-4427-ab75-eb56fa9c4786 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:07.247967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:07.261681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.261681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.261681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.261681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:07.261681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.271963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1068/2146] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 14:56:07.277593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:07.293117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62fcd5-b755-444e-8f47-5fbfccb9b623 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:07.299158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:07.299889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.300222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.300624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.301398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:07.303119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95fe03-4286-4b04-a239-9993db7a8b44 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.317161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1079/2147] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:56:07.322021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:07.341242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b7be-235f-42c6-9c18-0d28e0b27056 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:07.363748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:07.368122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.368122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.368122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] PATH_INFO: `/v3/projects/647928f0db494434a258915adc4f3635/users/bf623e2bc8b74b92ad21510a048e89a0/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.402519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647928f0db494434a258915adc4f3635, user_id=bf623e2bc8b74b92ad21510a048e89a0, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:07.407593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.558881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1069/2148] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:56:07 2022] PUT /identity/v3/projects/647928f0db494434a258915adc4f3635/users/bf623e2bc8b74b92ad21510a048e89a0/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:56:07.569450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9d847-ee9b-4629-89ba-3fee78e29d59 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.570240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9d847-ee9b-4629-89ba-3fee78e29d59 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.570976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9d847-ee9b-4629-89ba-3fee78e29d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.609341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fec9d847-ee9b-4629-89ba-3fee78e29d59 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:07.613397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fec9d847-ee9b-4629-89ba-3fee78e29d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:07.778428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1080/2149] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:56:07.800884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:07.803463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:07.948929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72541d2-609f-4525-a22e-f0fd26586c96 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:07.953590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:07.954657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:07.955409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:07.955409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:07.969174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:07.970713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:07.985257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1070/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:56:10.258113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f2d7-a376-4780-9dcc-c75d14781e02 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:10.258747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f2d7-a376-4780-9dcc-c75d14781e02 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:10.258747 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f2d7-a376-4780-9dcc-c75d14781e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:10.266659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:10.297563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7086f2d7-a376-4780-9dcc-c75d14781e02 None None] MFA Rules not processed for user `bf623e2bc8b74b92ad21510a048e89a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:10.299215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7086f2d7-a376-4780-9dcc-c75d14781e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:10.390658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1081/2151] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:10.403423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:10.407766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:10.486854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7f77-3c04-4b81-b72b-1605409c8c19 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:10.495485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:10.496216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:10.496504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:10.496785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:10.509581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:10.512938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21bb33-0d10-488a-8fe7-26d3a41a04f5 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:10.540863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1071/2152] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:56:12.559563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:12.560630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:12.560630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:12.588805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] MFA Rules not processed for user `bf623e2bc8b74b92ad21510a048e89a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:12.590210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:12.620702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1082/2153] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:20.521699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=82,keystone:DELETE=1,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:22.580298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=33 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:28.609708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f117-8bd2-48bf-b829-04052632c3a3 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:28.611236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f117-8bd2-48bf-b829-04052632c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:28.611236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f117-8bd2-48bf-b829-04052632c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:28.649395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-c3a3f117-8bd2-48bf-b829-04052632c3a3 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:28.650742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c3a3f117-8bd2-48bf-b829-04052632c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:28.779850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1072/2154] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:28.853909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:28.858385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:28.982486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db17ec-d0fb-4c97-9f18-3372f8b3a9b5 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:28.990420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:28.991353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:28.991776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:28.992274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:29.003831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:29.005745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:29.022209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1083/2155] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:56:31.511012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:31.512129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:31.513498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:31.578349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:31.582700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:31.605773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1073/2156] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:56:31.612667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:31.640239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f776ac8-eab7-4cdd-b21b-a8da49be7d90 service swift] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:31.650028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:31.651289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:31.652212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:31.653032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:31.677457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:31.697328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba68cfe-1d77-4073-92b8-bf73fe1c2aff service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:31.757903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1084/2157] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:56:32.598197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:32.608725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb19f-1e8e-44d9-b710-a87989907972 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:32.614295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:32.615720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:32.616209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:32.616682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:32.619927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:32.723516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:32.725123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:32.766525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1074/2158] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:56:34.124885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037858e9-ca44-4aff-ba09-c7f22cf27627 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:34.125482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037858e9-ca44-4aff-ba09-c7f22cf27627 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:34.126932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037858e9-ca44-4aff-ba09-c7f22cf27627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:34.217666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-037858e9-ca44-4aff-ba09-c7f22cf27627 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:34.219313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-037858e9-ca44-4aff-ba09-c7f22cf27627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:34.261546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1085/2159] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:34.286929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:34.314454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbceab-ad5e-4a4d-a14f-a7d318bb0025 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:34.321098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:34.322020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:34.322465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:34.322877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:34.345851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:34.347910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:34.358820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1075/2160] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:56:44.256321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=56 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:44.354300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=75 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:47.381555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580f76-d8b5-42d0-ae52-e4f4fcc79205 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:47.382444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580f76-d8b5-42d0-ae52-e4f4fcc79205 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:47.382444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580f76-d8b5-42d0-ae52-e4f4fcc79205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:47.402748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-46580f76-d8b5-42d0-ae52-e4f4fcc79205 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:47.404338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-46580f76-d8b5-42d0-ae52-e4f4fcc79205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:47.419479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1086/2161] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:47.430631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:47.444894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb88bb-a60c-4fb1-ac3d-5ef6794f61a8 service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:47.453397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:47.454483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:47.454944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:47.455465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:47.473747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:47.476665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:47.493444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1076/2162] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:48.524694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918a15-c0a2-4300-9ee2-72b029357d0b None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:48.526235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918a15-c0a2-4300-9ee2-72b029357d0b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:48.526963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918a15-c0a2-4300-9ee2-72b029357d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:48.557936 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a2918a15-c0a2-4300-9ee2-72b029357d0b None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:48.559509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a2918a15-c0a2-4300-9ee2-72b029357d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:48.583664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1087/2163] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:48.606525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:48.623045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4482-a8ef-4af6-a2f7-491a35ae0a44 service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:48.632542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:48.634396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:48.634955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:48.635488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:48.651925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:48.655236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:48.675184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1077/2164] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:49.746963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:49.747558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:49.747967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:49.790300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:49.792461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:49.806390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1088/2165] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:56:49.830035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:49.864748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179099-4b94-4b4b-88cf-a32072ad1db8 service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:49.867774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:49.868875 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:49.869374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:49.869813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:49.884679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:49.886671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:49.901029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1078/2166] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:52.635198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:52.637391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:52.794638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01637b3-7418-4b24-b6c5-50cd7fb82453 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:52.806706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:52.809270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:52.809270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:52.810028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:52.813903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:52.832850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:52.834418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017781c-d366-486e-bde1-a031de1163c1 service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:52.847037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1089/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:56:53.387306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:53.389447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:53.417642 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa3f1-4557-45c1-b41d-4ae3defbc564 service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:53.445636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:53.447016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:53.447304 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:53.447770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] PATH_INFO: `/v3/users/17432fd713ed455296e8af50fa4e1b52` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:53.450278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17432fd713ed455296e8af50fa4e1b52)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:53.454117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:53.701505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17432fd713ed455296e8af50fa4e1b52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:53.715334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17432fd713ed455296e8af50fa4e1b52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:53.751617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17432fd713ed455296e8af50fa4e1b52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:53.891248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17432fd713ed455296e8af50fa4e1b52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:53.926702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17432fd713ed455296e8af50fa4e1b52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:53.947268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1079/2168] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:56:53 2022] DELETE /identity/v3/users/17432fd713ed455296e8af50fa4e1b52 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:56:53.949343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:53.950177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:53.950334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:53.983661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:53.984986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:54.086387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1090/2169] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:56:54.100027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:54.103007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:54.231777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd20c3-3161-4903-a6da-9c5cd7c91843 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:54.235739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:54.236626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:54.237413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:54.237795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:54.274041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:54.276266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bcbbb-63dd-4ecc-a96c-8d3cf00aad16 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:54.310119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1080/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:56:54.714621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:56:54.716965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:54.757583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0633c-b93a-4b99-b6c7-836bbbab15c6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:56:54.765663 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:56:54.767719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:54.768540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:54.769216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] PATH_INFO: `/v3/projects/30ba3027dfb74db6aabbabe4b57609a3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:54.772112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ba3027dfb74db6aabbabe4b57609a3)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:56:54.776203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:56:55.029095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:55.029095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ba3027dfb74db6aabbabe4b57609a3', 'request_id': 'req-96fb0576-89e4-4f90-9602-5f10f418d1dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:55.189044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ba3027dfb74db6aabbabe4b57609a3', 'request_id': 'req-96fb0576-89e4-4f90-9602-5f10f418d1dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:55.201635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ba3027dfb74db6aabbabe4b57609a3', 'request_id': 'req-96fb0576-89e4-4f90-9602-5f10f418d1dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:55.220641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] The token cache is being invalidate because project 30ba3027dfb74db6aabbabe4b57609a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:56:55.225346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:55.225346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-96fb0576-89e4-4f90-9602-5f10f418d1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:56:55.225346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1091/2171] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:56:54 2022] DELETE /identity/v3/projects/30ba3027dfb74db6aabbabe4b57609a3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:56:56.173426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:56.177771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:56.177771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:56.177771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1081/2172] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:56:56.188621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48658e-96f8-406a-8d93-1e741c685934 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:56:56.189400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48658e-96f8-406a-8d93-1e741c685934 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:56:56.189400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48658e-96f8-406a-8d93-1e741c685934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:56:56.293731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4b48658e-96f8-406a-8d93-1e741c685934 None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:56:56.296001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4b48658e-96f8-406a-8d93-1e741c685934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:56:56.432028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1092/2173] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:02.527748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:02.530885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:02.617413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:02.685899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f735-7455-498f-9c75-baaaa0cdfa02 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:02.691162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:02.693727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:02.693727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:02.693727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:02.711548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:02.713636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b08cdb-84fb-455f-ac51-e75547c821f5 service glance] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:02.727839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1082/2174] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:03.037376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.037957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.037957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] PATH_INFO: `/` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.039242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1093/2175] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 14:57:03.044935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc5da-985c-45fe-8e0c-69b640db6078 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.045422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc5da-985c-45fe-8e0c-69b640db6078 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.045814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc5da-985c-45fe-8e0c-69b640db6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.066961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-29cdc5da-985c-45fe-8e0c-69b640db6078 None None] MFA Rules not processed for user `b24c24b909be4ce0aacd6b0fb765a637`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:03.068391 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-29cdc5da-985c-45fe-8e0c-69b640db6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.138108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1083/2176] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:57:03.155095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:03.157230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.171687 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093175-36e0-4106-82c4-33840ea0bc32 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:03.176441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:03.177109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.177387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.177674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.186266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:03.187727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30249e26-3845-477e-9a17-ca409c9419b2 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:03.197020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1094/2177] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:03.298689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.300147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.300147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] PATH_INFO: `/` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.301558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1084/2178] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jun 15 14:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 14:57:03.308611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6496d0-75b0-491b-9b02-ae8ca21614ac None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.308967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6496d0-75b0-491b-9b02-ae8ca21614ac None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.309285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6496d0-75b0-491b-9b02-ae8ca21614ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.332443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8d6496d0-75b0-491b-9b02-ae8ca21614ac None None] MFA Rules not processed for user `8b2601ad8d254730b33d16e6ed1156cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:03.333867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8d6496d0-75b0-491b-9b02-ae8ca21614ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.344426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1095/2179] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jun 15 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:03.355744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:03.357725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.373579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a91d7b-cc47-44af-940c-4146b54aebd8 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:03.378183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:03.378872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.379154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.379435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.390997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:03.392532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:03.406302 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1085/2180] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:03.708248 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.708692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.709122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.731102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:03.732673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.799057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1096/2181] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:03.815704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:03.819203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:03.938506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8ebd-199c-4c76-9be5-2c089191a921 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:03.946312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:03.954114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:03.954114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:03.954114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:03.963544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:03.965203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441481-5055-47cb-b656-f42e314ec8a0 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:03.975291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1086/2182] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:07.721037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:07.724955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:07.754830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:07.815664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88c447-8c79-43b1-b380-28e7903cdcbe None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:07.820460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:07.821347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:07.821625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:07.821934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] PATH_INFO: `/v3/users/9aaaefcafdc04d4eb7a8b3f8f657be94` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:07.823184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aaaefcafdc04d4eb7a8b3f8f657be94)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:07.825209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:08.103969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aaaefcafdc04d4eb7a8b3f8f657be94'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:08.111542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aaaefcafdc04d4eb7a8b3f8f657be94'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:08.112369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aaaefcafdc04d4eb7a8b3f8f657be94'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:08.126656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aaaefcafdc04d4eb7a8b3f8f657be94'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:08.127998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aaaefcafdc04d4eb7a8b3f8f657be94'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:08.133541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:08.134061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:08.134231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:08.153146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:08.154422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:08.162295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1087/2183] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:08.175050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:08.176889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:08.196726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1d1b3-bf2b-4d39-8c86-42d9416104f4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:08.203151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:08.203995 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:08.204340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:08.204694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:08.214276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1097/2184] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:57:07 2022] DELETE /identity/v3/users/9aaaefcafdc04d4eb7a8b3f8f657be94 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:08.222626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:08.222626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8692a-f204-478b-a4d7-a19a7ac76e4a service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:08.233110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1088/2185] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 14:57:08.497087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:08.498594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:08.635331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491caf28-0ade-4f25-aa20-def5d886e784 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:08.642269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:08.647337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:08.647337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:08.647337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] PATH_INFO: `/v3/projects/246a899406c44cfda3cc3460346f02ed` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:08.648923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246a899406c44cfda3cc3460346f02ed)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:08.653815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:08.826149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:08.839652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246a899406c44cfda3cc3460346f02ed', 'request_id': 'req-59c988b5-70c9-4941-81cc-047c219cc805'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:09.174806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246a899406c44cfda3cc3460346f02ed', 'request_id': 'req-59c988b5-70c9-4941-81cc-047c219cc805'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:09.184954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246a899406c44cfda3cc3460346f02ed', 'request_id': 'req-59c988b5-70c9-4941-81cc-047c219cc805'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:09.199588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] The token cache is being invalidate because project 246a899406c44cfda3cc3460346f02ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:57:09.199914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:09.200593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-59c988b5-70c9-4941-81cc-047c219cc805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:09.202179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1098/2186] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:57:08 2022] DELETE /identity/v3/projects/246a899406c44cfda3cc3460346f02ed => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:09.209874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.210410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.214500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.244480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:09.245888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:09.257220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:09.316972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1089/2187] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:09.325549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.325839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.326222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.348683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:09.350340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:09.359097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1099/2188] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:09.366531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.378685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e352c-ca59-46dc-aa43-836213e6f39b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.383600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.384535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.384895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.385248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.386058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:57:09.386447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.388179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:09.403282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1090/2189] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:57:09.407447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.419192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907760e3-ad06-4915-aff0-52c1fe7e097a None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.424678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.425558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.425782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.426063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.426774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.429117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:09.560545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1100/2190] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:57:09 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:57:09.565946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.576352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cca0c-b9c2-497d-ae02-3c06d9842603 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.654592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.655254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.655563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.655868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.656572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.658587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:09.765155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1091/2191] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:57:09 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:57:09.770225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.783355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590b8b-bf9f-4186-a83d-9c262efbd174 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.788916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.789611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.789889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.790164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.790893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.792597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:09.808290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1101/2192] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:09.812512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.828674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b48742-1fce-47c5-ac66-0b4ade225745 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.834077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.835025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.835449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.835792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.836809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.838533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ebf83-e583-4915-8302-edc9c134f720 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:09.855546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1092/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:09.860759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:09.873075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0e1d0-4b2e-48ac-bc81-52a448969099 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:09.879193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:09.880129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:09.880411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:09.880686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] PATH_INFO: `/v3/projects/d71fede6a15246928168b6b48224847b/users/ffe17e600bea4210ac67124acdd37ee9/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:09.898355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71fede6a15246928168b6b48224847b, user_id=ffe17e600bea4210ac67124acdd37ee9, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:09.901076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:10.012074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1102/2194] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:57:09 2022] PUT /identity/v3/projects/d71fede6a15246928168b6b48224847b/users/ffe17e600bea4210ac67124acdd37ee9/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:10.024165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:10.024456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:10.024734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:10.072454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] MFA Rules not processed for user `ffe17e600bea4210ac67124acdd37ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:10.073781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:10.193602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1093/2195] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:10.207218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:10.208828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:10.319736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dc158-3d0f-44a3-90a3-632d4fb20e57 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:10.323536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:10.324214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:10.324495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:10.324772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:10.335252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:10.336751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e0cb2-843e-4355-b535-3173e3d040c8 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:10.347465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1103/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:14.120099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:14.141040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:14.204776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf426ad-a65c-4b0d-b9ab-b1b26384ed07 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:14.221420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:14.224264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:14.224561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:14.224849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] PATH_INFO: `/v3/users/ffe17e600bea4210ac67124acdd37ee9` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:14.226447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe17e600bea4210ac67124acdd37ee9)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:14.228480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:14.823712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe17e600bea4210ac67124acdd37ee9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:14.823712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe17e600bea4210ac67124acdd37ee9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:14.843525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe17e600bea4210ac67124acdd37ee9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:15.028198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe17e600bea4210ac67124acdd37ee9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:15.041463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe17e600bea4210ac67124acdd37ee9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:15.052655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1094/2197] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:57:14 2022] DELETE /identity/v3/users/ffe17e600bea4210ac67124acdd37ee9 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:15.055582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:15.056139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:15.056139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:15.077746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:15.084011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:15.148981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:15.185785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1104/2198] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:15.195635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:15.197268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:15.301571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd05eb-faac-4e31-8aef-407916954298 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:15.305392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:15.306050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:15.306330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:15.306598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:15.317771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:15.319212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce75c8-1676-4afd-a5f1-8ff0212bafb4 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:15.331326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1095/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:57:15.935172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:15.936669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:15.949898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6e2d9-f74e-4c32-8e70-da21c385eebf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:15.959554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:15.960756 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:15.961136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:15.961474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] PATH_INFO: `/v3/projects/d71fede6a15246928168b6b48224847b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:15.962802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71fede6a15246928168b6b48224847b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:15.964929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.089174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71fede6a15246928168b6b48224847b', 'request_id': 'req-cfcf003b-f591-4b62-8f0d-74476078501a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:16.165288 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71fede6a15246928168b6b48224847b', 'request_id': 'req-cfcf003b-f591-4b62-8f0d-74476078501a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:16.173156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71fede6a15246928168b6b48224847b', 'request_id': 'req-cfcf003b-f591-4b62-8f0d-74476078501a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:16.186372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] The token cache is being invalidate because project d71fede6a15246928168b6b48224847b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:57:16.186759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:16.187526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cfcf003b-f591-4b62-8f0d-74476078501a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:57:16.190833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1105/2200] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:57:15 2022] DELETE /identity/v3/projects/d71fede6a15246928168b6b48224847b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:16.197358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.202514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.202514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.223685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:16.224983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:16.262094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:16.313685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1096/2201] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:16.323511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.323942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.324553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.351624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:16.353051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:16.362690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1106/2202] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:16.366887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.379273 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6331089-9bc9-48e9-b2fd-4e08c9f7db70 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.384799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.385625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.386004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.386376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.387229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:57:16.387644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.389573 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.405279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1097/2203] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:57:16.410950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.421478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2b8c-fcc6-4619-9858-bcd722c8716f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.429072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.430112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.430404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.430774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.431717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.433674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.561501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1107/2204] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:57:16.566233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.576808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa576eb-bb88-47a1-9051-de810a20d56f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.682485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.683184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.683471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.683750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.684494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.686845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.774423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1098/2205] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:57:16 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:57:16.776869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.789512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec933b-a135-426e-9a1a-89ed8fb65288 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.794804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.795640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.795964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.796242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.797081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.799639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.817484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1108/2206] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:16.821695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.833967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e1aa4-debe-46bf-ad37-427739ef59d5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.842106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.842909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.843456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.843675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.844666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.847013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492817-09a3-427b-9530-5e39f61cbd47 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.860806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1099/2207] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:16.866367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:16.882480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23fc15-bd3f-4e12-b0bd-43e47d4a6cf3 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:16.887755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:16.888852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.889139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.889466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] PATH_INFO: `/v3/projects/37ff36dd761d426994c9cf4b9c6adad9/users/7a5e087e2e3841e68414cff4ec2cf569/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:16.910535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff36dd761d426994c9cf4b9c6adad9, user_id=7a5e087e2e3841e68414cff4ec2cf569, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:16.913634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:16.989436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1109/2208] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:57:16 2022] PUT /identity/v3/projects/37ff36dd761d426994c9cf4b9c6adad9/users/7a5e087e2e3841e68414cff4ec2cf569/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:57:16.995252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f44-de67-4c91-b4f0-241d9bfbf5b8 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:16.995549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f44-de67-4c91-b4f0-241d9bfbf5b8 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:16.996700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f44-de67-4c91-b4f0-241d9bfbf5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:17.026096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-97432f44-de67-4c91-b4f0-241d9bfbf5b8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:17.028494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-97432f44-de67-4c91-b4f0-241d9bfbf5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:17.160145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1100/2209] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:57:17.170010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:17.172372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:17.244504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870449f-b36b-4383-bd0f-898932da2b96 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:17.248187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:17.248845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:17.249123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:17.249398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:17.259589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:17.261075 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:17.272186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1110/2210] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:23.978796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:23.980004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:23.980004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:24.014819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] MFA Rules not processed for user `7a5e087e2e3841e68414cff4ec2cf569`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:24.016291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:24.066598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:24.119048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1101/2211] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:57:24.123440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:24.138554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcfbb0-eb05-40ad-aa0f-809104af992d service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:24.146578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:24.148496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:24.149122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:24.149619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:24.150499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:24.152976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:24.161339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:24.365450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1111/2212] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:57:24 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:57:24.367594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:24.395594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac4ac-5b31-4552-ac55-daf673775054 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:24.498417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:24.499455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:24.499961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:24.500381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:24.501593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:24.506964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:24.918973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1102/2213] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:57:24 2022] POST /identity/v3/users => generated 298 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:57:24.922788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:24.935689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f295e3-7254-4e47-a46e-234c7cfb1ff3 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:24.941393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:24.942156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:24.942502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:24.942809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:24.943721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:24.945942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:24.964829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1112/2214] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:24.972235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:24.992100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11244e-6aa0-41f2-b9f0-c5b0504c3faa admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:24.998833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:24.999759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:25.000073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:25.000349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] PATH_INFO: `/v3/projects/e8f8202263f446a88bdee467ad5c26d8/users/72c3750bc368418382623db4b9f5aa8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:25.018486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f8202263f446a88bdee467ad5c26d8, user_id=72c3750bc368418382623db4b9f5aa8d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:25.021402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:25.158754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1103/2215] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:57:24 2022] PUT /identity/v3/projects/e8f8202263f446a88bdee467ad5c26d8/users/72c3750bc368418382623db4b9f5aa8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 14:57:25.162459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:25.176362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27eaa6-eac2-411d-bfe4-d92a5b1baddf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:25.275156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:25.278229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:25.278564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:25.278853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:25.284311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:25.290278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262561f-cc19-407f-89c7-3273808e25b2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:25.309333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1113/2216] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:57:25.315580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:25.338380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cf63-afe6-4788-bdf7-360fb2afa717 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:25.347094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:25.348119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:25.349271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:25.349520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] PATH_INFO: `/v3/projects/e8f8202263f446a88bdee467ad5c26d8/users/72c3750bc368418382623db4b9f5aa8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:25.353582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f8202263f446a88bdee467ad5c26d8, user_id=72c3750bc368418382623db4b9f5aa8d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:25.356507 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:25.373467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1104/2217] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:57:25 2022] PUT /identity/v3/projects/e8f8202263f446a88bdee467ad5c26d8/users/72c3750bc368418382623db4b9f5aa8d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:57:29.798946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9849d8b-d0d6-4208-bc5c-d815e125558f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:29.800284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9849d8b-d0d6-4208-bc5c-d815e125558f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:29.800570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9849d8b-d0d6-4208-bc5c-d815e125558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:29.827500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f9849d8b-d0d6-4208-bc5c-d815e125558f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:29.829078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f9849d8b-d0d6-4208-bc5c-d815e125558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:29.923007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1114/2218] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:29.950807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:29.959968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:30.103703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad66db-1c06-4cdd-98f3-261b2ce046ce admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:30.113263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:30.113957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:30.114552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:30.114826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:30.127972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:30.129775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:30.149379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1105/2219] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:34.592301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869187b8-82fa-4a25-b626-10c22dbc5bc6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:34.592864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869187b8-82fa-4a25-b626-10c22dbc5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:34.592864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869187b8-82fa-4a25-b626-10c22dbc5bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:34.632669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-869187b8-82fa-4a25-b626-10c22dbc5bc6 None None] MFA Rules not processed for user `72c3750bc368418382623db4b9f5aa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:34.634058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-869187b8-82fa-4a25-b626-10c22dbc5bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:34.720289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:34.725837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1115/2220] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:34.740130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:34.743997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:34.750960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:34.822888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64409d1-dba1-49a6-96d9-9e9e5e779b9c service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:34.833284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:34.834023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:34.834448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:34.834727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:34.910843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:34.912569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:34.924654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1106/2221] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:35.267329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5476b5-fce2-419d-9197-0816b6c691d5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:35.270192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5476b5-fce2-419d-9197-0816b6c691d5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:35.270192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5476b5-fce2-419d-9197-0816b6c691d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:35.295421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9f5476b5-fce2-419d-9197-0816b6c691d5 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:35.296839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9f5476b5-fce2-419d-9197-0816b6c691d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:35.378051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1116/2222] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:35.405354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:35.406963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:35.501931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b713e3-51c0-4c88-ad6b-7193c4d2f425 service glance] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:35.507907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:35.508566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:35.509180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:35.509180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:35.519545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:35.521350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:35.538755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1107/2223] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:57:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:36.555760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ce60-0159-43fe-a472-6bc014b199ef None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:36.556842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ce60-0159-43fe-a472-6bc014b199ef None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:36.557285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ce60-0159-43fe-a472-6bc014b199ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:36.582655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b513ce60-0159-43fe-a472-6bc014b199ef None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:36.584239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b513ce60-0159-43fe-a472-6bc014b199ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:36.609010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1117/2224] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:36.613753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:36.630039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1d6e-8eb1-4588-8410-2336006ee4ba service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:36.635890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:36.636559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:36.636844 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:36.637120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:36.651593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:36.653667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:36.666188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1108/2225] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:36.830967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024050cc-47f4-4125-ad31-aedaad1786da None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:36.831660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024050cc-47f4-4125-ad31-aedaad1786da None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:36.831984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024050cc-47f4-4125-ad31-aedaad1786da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:36.854712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-024050cc-47f4-4125-ad31-aedaad1786da None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:36.856401 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-024050cc-47f4-4125-ad31-aedaad1786da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:36.867071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1118/2226] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:57:37.228622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:37.230806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:37.261511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32ea2-4f0b-4016-90e6-e9edaa7b87ff service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:37.269543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:37.271000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:37.271478 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:37.272047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:37.297711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:37.301980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:37.348955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1109/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:45.319183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96eb65-1343-49e9-b3c1-aaddd1a1948c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:45.319751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96eb65-1343-49e9-b3c1-aaddd1a1948c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:45.319751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96eb65-1343-49e9-b3c1-aaddd1a1948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:45.339982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ef96eb65-1343-49e9-b3c1-aaddd1a1948c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:45.341565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ef96eb65-1343-49e9-b3c1-aaddd1a1948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:45.352902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1119/2228] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:45.382054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:45.396171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4f5e-65f0-466f-895a-4966b36a62b2 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:45.401795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:45.402504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:45.402819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:45.403188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:45.435089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:45.435089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1af63-2052-4027-9a81-497b539adf5b service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:45.465587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1110/2229] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:48.842921 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3173-071a-4451-a4c0-de770de26391 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:48.843867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3173-071a-4451-a4c0-de770de26391 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:48.844294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3173-071a-4451-a4c0-de770de26391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:48.867629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-595e3173-071a-4451-a4c0-de770de26391 None None] MFA Rules not processed for user `7a5e087e2e3841e68414cff4ec2cf569`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:48.869272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-595e3173-071a-4451-a4c0-de770de26391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:48.884046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1120/2230] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:49.256767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a10b-2016-47a9-a500-3b006f3c955f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:49.257743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a10b-2016-47a9-a500-3b006f3c955f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:49.258096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a10b-2016-47a9-a500-3b006f3c955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:49.283595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-5a70a10b-2016-47a9-a500-3b006f3c955f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:49.285053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5a70a10b-2016-47a9-a500-3b006f3c955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:49.294754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1111/2231] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:57:49.321506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e3173-071a-4451-a4c0-de770de26391 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:49.337387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e3173-071a-4451-a4c0-de770de26391 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:49.345875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:49.346817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:49.349072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:49.349589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:49.363517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:49.365431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4a72-8d7e-42aa-a483-ad06de54676d service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:49.379017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1121/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:49.752163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:49.758308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:49.758308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:49.759425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:49.778771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] MFA Rules not processed for user `94374d8e4dfc4cd5aa0f55bedaf590c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:49.780092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:49.840983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1112/2233] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:53.521992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c236dc-5eab-43cd-8f4c-089ad60b4566 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:53.522527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c236dc-5eab-43cd-8f4c-089ad60b4566 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:53.522744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c236dc-5eab-43cd-8f4c-089ad60b4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:53.540964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-55c236dc-5eab-43cd-8f4c-089ad60b4566 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:53.542186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-55c236dc-5eab-43cd-8f4c-089ad60b4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:53.550777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1122/2234] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:53.576352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:53.589609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81be639-5949-4aef-95f7-eb6128e86a7b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:53.595120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:53.596056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:53.596341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:53.596829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:53.606017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:53.607632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:53.618956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1113/2235] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:57:55.143880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ff625-c1b1-4e43-a8a2-a7c1c1624a82 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:55.144344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ff625-c1b1-4e43-a8a2-a7c1c1624a82 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:55.144617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ff625-c1b1-4e43-a8a2-a7c1c1624a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:55.197000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-576ff625-c1b1-4e43-a8a2-a7c1c1624a82 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:57:55.198253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-576ff625-c1b1-4e43-a8a2-a7c1c1624a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:57:55.214035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1123/2236] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:57:55.227294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:57:55.239465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb35-1a8e-4adc-87f3-595a0a730331 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:57:55.246128 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:57:55.246771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:57:55.247056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:57:55.247331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:57:55.259747 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:57:55.261580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:57:55.278763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1114/2237] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 14:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:05.182112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=50 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:05.268285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=36 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:06.125056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1622-6d71-4b61-8226-e1822c507bac None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:06.125056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1622-6d71-4b61-8226-e1822c507bac None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:06.125056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1622-6d71-4b61-8226-e1822c507bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:06.149366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b4ce1622-6d71-4b61-8226-e1822c507bac None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:06.151672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b4ce1622-6d71-4b61-8226-e1822c507bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:06.166340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1124/2238] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:58:06.188219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:06.201808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6f3a2-c4a9-45f7-b7ac-3e370693d462 service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:06.210350 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:06.211516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:06.212059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:06.212510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:06.238266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:06.241099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:06.254225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1115/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:58:10.560831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb70a-e5bc-4b9d-8499-fde3f21d219d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:10.561399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb70a-e5bc-4b9d-8499-fde3f21d219d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:10.561642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb70a-e5bc-4b9d-8499-fde3f21d219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:10.581648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-61ddb70a-e5bc-4b9d-8499-fde3f21d219d None None] MFA Rules not processed for user `10942dbd553e44dcb49a48de4dd65d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:10.582879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-61ddb70a-e5bc-4b9d-8499-fde3f21d219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:10.640802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1125/2240] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:58:16.247614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=6 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:20.633890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=28 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:32.273495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:32.274916 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:32.332837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455b6b-5506-44b6-93b9-57dfb98750b0 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:32.336515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:32.337159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:32.337443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:32.337719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:32.347452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:32.348919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c33bd-3e14-45b9-8aff-504f375c2978 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:32.358647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1116/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:58:33.943714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:33.949992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:33.949992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:33.964505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] MFA Rules not processed for user `bf623e2bc8b74b92ad21510a048e89a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:33.966708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:34.043842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1126/2242] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:58:37.492208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:37.494778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:37.494778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:37.513557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] MFA Rules not processed for user `fd48e2130723461d8d09484cb3b7a0df`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:37.514802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:37.574537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1117/2243] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:58:40.341328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:40.353487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c880f-ca6b-4733-bef6-7c64320292f6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:40.358247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:40.359860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:40.359860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:40.359860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:40.362700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:40.380308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:40.382129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3291-5a28-4cff-8385-5448a0ad8dff service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:40.395599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1127/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:58:41.713177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:41.724008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecef4b5-0e97-475e-af61-fddf739532f9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:41.741592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:41.742804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:41.743376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:41.744377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:41.760279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:41.792815 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:41.795034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:41.817623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1118/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:58:48.231667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:48.232262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:48.232262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:48.251541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] MFA Rules not processed for user `8177948cd6074d1f8240500be6bcd424`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:48.252795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:48.310760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1128/2246] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:58:49.097655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:49.099928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:49.195619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264992e2-7252-4cfa-bc1e-73a42c5f7f42 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:49.201030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:49.201696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:49.201982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:49.208041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:49.208041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:49.217696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:49.220102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93690477-5844-46b7-aa1c-dd50efbe2d6d service placement] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:49.231021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1119/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:58:54.857340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:54.872232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c818-53c9-4d7e-8fa8-fcbefaee9cca None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:54.882823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:54.882823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:54.882823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:54.882823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:54.883216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:54.891932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:54.893557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:54.902470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1129/2248] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:58:57.894162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:57.895960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:57.895960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:57.904198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:57.919044 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:58:57.923944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:58:57.930721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1120/2249] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:58:58.010192 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:58:58.028821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c65a-723a-4b6e-96db-92876e905e39 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:58:58.032453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:58:58.033128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:58:58.033472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:58:58.033811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:58:58.043696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:58:58.045449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff1169-edfb-4aa9-bbbd-e5a0db26466f service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:58:58.062041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1130/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:02.812651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:02.826783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd054-4808-4bfc-967a-30e961010c0b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:02.833823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:02.834646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:02.834843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:02.835120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:02.836997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:02.848740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:02.850701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:02.860106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1121/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:03.553569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:03.554114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:03.554114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:03.560728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=69 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:03.573242 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:03.574463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:03.582937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1131/2252] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:03.606693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:03.618527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ba155-ce52-4917-8516-ceb0849a21ba service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:03.624282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:03.626083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:03.626083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:03.626083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:03.635171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:03.636858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4047-1842-4c7e-8797-5e98488d3346 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:03.647885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1122/2253] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:05.630064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:05.631465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:05.690088 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80561-2647-4e31-ba25-c12aeebb1bc8 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:05.693714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:05.694392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:05.694671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:05.694944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:05.696866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:05.709152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:05.710607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:05.720365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1132/2254] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:07.413810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:07.414371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:07.414485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:07.434351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:07.435591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:07.444698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1123/2255] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:07.477978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:07.490735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b429-bd76-4fec-a0f8-cd6619f8d2e2 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:07.496399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:07.497055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:07.497336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:07.497609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:07.507387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:07.509013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5654d53-3e32-4886-ab89-6a8c5449a2b0 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:07.519778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1133/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:10.485079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:10.499287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28f1c-671b-4897-b9ca-2d29fd354f6f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:10.505910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:10.506857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:10.507316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:10.508335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:10.511634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:10.529083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:10.530847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:10.544908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1124/2257] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:12.724487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f4ae-f04f-487c-8ede-d81d6c737ef2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:12.725036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f4ae-f04f-487c-8ede-d81d6c737ef2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:12.725036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f4ae-f04f-487c-8ede-d81d6c737ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:12.746062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-bdb3f4ae-f04f-487c-8ede-d81d6c737ef2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:12.747277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bdb3f4ae-f04f-487c-8ede-d81d6c737ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:12.755655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1134/2258] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:12.860509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:12.872420 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937a3c2-6060-4d95-86f0-fe855b1ecbe7 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:12.878368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:12.878368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:12.887780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:12.887780 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:12.888392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:12.889996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:12.901137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1125/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:21.190392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:21.191830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:21.191830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:21.210963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:21.212214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:21.220592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1135/2260] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jun 15 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:21.257548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:21.270395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c936430-77b0-45aa-a1f2-55219fa0cb9d service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:21.276088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:21.276732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:21.277015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:21.277292 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:21.286266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:21.287906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:21.297885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1126/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:23.783843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:23.796851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21f7e1-6b2b-4f9b-b6a4-4eb927e04b33 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:23.802521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:23.803157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:23.803437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:23.803711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:23.805587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:23.816801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:23.818540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:23.829599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1136/2262] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:27.052319 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:27.066809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c380c6-1c18-4194-9f17-0527c8f24e46 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:27.078660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:27.078660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:27.078660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:27.078660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:27.079114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:27.090201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:27.091927 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:27.107451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1127/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 14:59:33.824717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=46 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:37.098920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=41 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:47.463432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:47.475640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e93a-9ffe-462a-a759-f7a5299d15d2 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:47.489463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:47.490304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:47.491034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:47.491455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:47.494858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:47.522133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:47.525227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:47.539483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1137/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:50.191372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:50.201127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b5e3-33d4-4835-b2da-130712ed62b9 service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:50.204975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:50.205444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:50.205737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:50.206013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:50.207953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:50.222896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:50.224600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7767c8-05b1-4115-9bbe-8cf518762b4b service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:50.235863 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1128/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:52.584897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:52.601087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437723ac-3a55-43ae-9a91-fc38b4cbfa82 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:52.607935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:52.608713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:52.609060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:52.609402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:52.611552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:52.624134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:52.625889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:52.637712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1138/2266] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:54.277640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:54.278538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:54.279011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:54.306614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] MFA Rules not processed for user `94374d8e4dfc4cd5aa0f55bedaf590c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:54.307896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:54.318096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1129/2267] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:54.744417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:54.750246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:54.752958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:54.766224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a80bda-1bbc-41f5-876a-c16e92f0aad6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:54.770774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:54.772207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:54.772207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:54.772515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03c17f-5bde-4963-9a44-0bdd2dc65642 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:54.772688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:54.774166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:54.777853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:54.778815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:54.779276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:54.779661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] PATH_INFO: `/v3/users/10942dbd553e44dcb49a48de4dd65d1d` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:54.781275 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=10942dbd553e44dcb49a48de4dd65d1d)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:54.784914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:54.786866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:54.789286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:54.798955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1130/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:55.000028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10942dbd553e44dcb49a48de4dd65d1d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.012184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10942dbd553e44dcb49a48de4dd65d1d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.016195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10942dbd553e44dcb49a48de4dd65d1d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.029638 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10942dbd553e44dcb49a48de4dd65d1d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.030398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-cbce3aea-4321-4e2a-b031-8217986ccadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10942dbd553e44dcb49a48de4dd65d1d'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.152353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1139/2269] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 14:59:54 2022] DELETE /identity/v3/users/10942dbd553e44dcb49a48de4dd65d1d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:59:55.598922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:55.612517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90480f65-bb1f-422e-a196-861320d272dc service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:55.678289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:55.682322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:55.682322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:55.682322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] PATH_INFO: `/v3/projects/795dbfaaab4b48dcab1c00e9430d9642` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:55.682322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795dbfaaab4b48dcab1c00e9430d9642)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:55.682971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:55.839058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795dbfaaab4b48dcab1c00e9430d9642', 'request_id': 'req-af83df84-fd39-4511-867b-60acdb8455c9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.934179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795dbfaaab4b48dcab1c00e9430d9642', 'request_id': 'req-af83df84-fd39-4511-867b-60acdb8455c9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.945102 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795dbfaaab4b48dcab1c00e9430d9642', 'request_id': 'req-af83df84-fd39-4511-867b-60acdb8455c9'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.959374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] The token cache is being invalidate because project 795dbfaaab4b48dcab1c00e9430d9642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 14:59:55.959374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.960448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af83df84-fd39-4511-867b-60acdb8455c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 14:59:55.965766 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1131/2270] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 14:59:55 2022] DELETE /identity/v3/projects/795dbfaaab4b48dcab1c00e9430d9642 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:59:55.967119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:55.967604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:55.967702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:55.989569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:55.991133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:56.061117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1140/2271] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 14:59:56.069658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.069923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.070211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.089581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:56.090882 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:56.099356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1132/2272] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:56.103932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.114894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996b24-70e1-4475-bed7-e7369a0b62de None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.119538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.120234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.120613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.126549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.126549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 14:59:56.126549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.126549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.140057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1141/2273] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 14:59:56.141262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.151451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133650e5-6065-4a85-bed7-980a403c10ee None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.159525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.159525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.159525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.159525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.159962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.160864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.322505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1133/2274] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:59:56.326436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.337846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8aa96-89de-4038-8d08-4cda94220935 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.376689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:56.407691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.408533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.408863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.409847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.410715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.412692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.500359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1142/2275] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:59:56 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:59:56.501713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.512897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f912-ac33-4158-bc08-c2c1f92c41c7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.517592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.518894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.519174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.519445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.520209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.521799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.532104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1134/2276] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:59:56.536595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.546910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24cc27-9710-4eac-9fcb-6e15e33bc6f9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.551947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.552618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.552905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.553178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.553914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.555556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9cd24-5eae-4a34-9be7-81b31eea752f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.567251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1143/2277] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:59:56.571771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.583122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63828-b810-4a14-8944-e78495de3f0b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.587738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.588645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.588925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.589203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] PATH_INFO: `/v3/projects/40be962134104b6fb4051d48ff145fc1/users/6b68981fa6fb42739b502c7b9424e655/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.592329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:56.604412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40be962134104b6fb4051d48ff145fc1, user_id=6b68981fa6fb42739b502c7b9424e655, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.607064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:56.714589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1135/2278] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:59:56 2022] PUT /identity/v3/projects/40be962134104b6fb4051d48ff145fc1/users/6b68981fa6fb42739b502c7b9424e655/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:59:56.725001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.725289 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.725567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.758003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] MFA Rules not processed for user `6b68981fa6fb42739b502c7b9424e655`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:56.760347 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:56.869116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1144/2279] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:56.874088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:56.949329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b3e3-ec84-4450-9f41-3dbf25de6ff5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:56.958939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:56.960078 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:56.960440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:56.961687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:56.962479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:56.964542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.137052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1136/2280] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 14:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 14:59:57.140952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.152563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b773-2e23-4580-a99c-5433f7f18c14 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.212361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.213036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.213312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.213590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.214807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.216306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.309086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1145/2281] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 14:59:57 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 14:59:57.313459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.324219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6b2-af3d-41c7-824d-2fae0c670e2a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.328960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.329652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.329940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.330222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.330964 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.332950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.346149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1137/2282] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:59:57.351784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.364506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e326-661e-49be-b9c4-59517fdb340c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.369655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.370599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.374073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.374073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] PATH_INFO: `/v3/projects/293a5cf3f9c04d64826ca241a450da43/users/e8d28a309c13492db5220500734848a9/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.388293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293a5cf3f9c04d64826ca241a450da43, user_id=e8d28a309c13492db5220500734848a9, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.391015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.472258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1146/2283] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:59:57 2022] PUT /identity/v3/projects/293a5cf3f9c04d64826ca241a450da43/users/e8d28a309c13492db5220500734848a9/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:59:57.476114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.488294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120103-1d1f-468f-bc93-e107e1814ac8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.572115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.573014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.573358 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.573705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.574531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.576295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93759956-94e2-4546-8359-eb7095143967 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.587653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1138/2284] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 14:59:57.592038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.602835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb571d-2e8f-49d6-ad9b-8e42561d0414 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.608142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.608979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.609258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.609528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] PATH_INFO: `/v3/projects/293a5cf3f9c04d64826ca241a450da43/users/e8d28a309c13492db5220500734848a9/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.611560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293a5cf3f9c04d64826ca241a450da43, user_id=e8d28a309c13492db5220500734848a9, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.614948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.617529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:57.626621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1147/2285] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 14:59:57 2022] PUT /identity/v3/projects/293a5cf3f9c04d64826ca241a450da43/users/e8d28a309c13492db5220500734848a9/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 14:59:57.638989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.639499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.639593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.672671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] MFA Rules not processed for user `e8d28a309c13492db5220500734848a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 14:59:57.674011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:57.722990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:57.748809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1139/2286] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 14:59:57.760981 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:57.762818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 14:59:57.834029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63350da-7a15-4793-a6bb-8204d4c4b613 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:57.837787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:57.838445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:57.838733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:57.839002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:57.849511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:57.850974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:57.864801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1148/2287] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 14:59:58.110829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 14:59:58.121271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc32116-ce5b-4d94-9377-7e36c8c2afe4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 14:59:58.125197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 14:59:58.125867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 14:59:58.126149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 14:59:58.126418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 14:59:58.189089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 14:59:58.191070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 14:59:58.201580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1140/2288] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:07.856933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:08.197212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=37 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:08.691612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:08.694547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:08.811122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4654ff-dbd6-402a-a3c2-03ec409b6e11 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:08.818302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:08.818968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:08.819250 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:08.819525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:08.821729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:08.837197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:08.838826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:08.856030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1149/2289] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:08.900661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:08.903022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:08.992926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9355-4953-43e1-9ac2-4bb1576b6754 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:09.000894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:09.002591 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:09.003069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:09.003578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] PATH_INFO: `/v3/users/bf623e2bc8b74b92ad21510a048e89a0` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:09.006173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf623e2bc8b74b92ad21510a048e89a0)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:09.009820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:09.337753 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf623e2bc8b74b92ad21510a048e89a0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:09.338985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf623e2bc8b74b92ad21510a048e89a0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:09.354785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf623e2bc8b74b92ad21510a048e89a0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:09.422047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf623e2bc8b74b92ad21510a048e89a0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:09.433822 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-39669802-ad3b-4da3-8888-871adc3f258d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf623e2bc8b74b92ad21510a048e89a0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:09.445016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1141/2290] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:08 2022] DELETE /identity/v3/users/bf623e2bc8b74b92ad21510a048e89a0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:09.707202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:09.721352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babcb1-6d35-4c0d-8604-f3f398b0507d service placement] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:09.804762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:09.805710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:09.806105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:09.806596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] PATH_INFO: `/v3/projects/647928f0db494434a258915adc4f3635` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:09.807892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=647928f0db494434a258915adc4f3635)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:09.810160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:09.974005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647928f0db494434a258915adc4f3635', 'request_id': 'req-c8646480-9865-4522-8dba-7b0fd194ee6c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:10.086008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647928f0db494434a258915adc4f3635', 'request_id': 'req-c8646480-9865-4522-8dba-7b0fd194ee6c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:10.096716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647928f0db494434a258915adc4f3635', 'request_id': 'req-c8646480-9865-4522-8dba-7b0fd194ee6c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:10.112198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] The token cache is being invalidate because project 647928f0db494434a258915adc4f3635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:10.112575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:10.113943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c8646480-9865-4522-8dba-7b0fd194ee6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:10.118395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1150/2291] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:09 2022] DELETE /identity/v3/projects/647928f0db494434a258915adc4f3635 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:10.123394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.123974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.123974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.146730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:10.148035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:10.224372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1142/2292] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:10.232025 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.232332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.232727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.257087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:10.258374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:10.266629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1151/2293] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:10.271700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.281596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034ce2-0c64-4d74-82fa-2c1dbd99f2b9 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.287326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.289751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.289751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.289751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.289751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:00:10.290365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.292125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.307381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1143/2294] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:00:10.312336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.334644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456c878-b3e7-40b9-b6f3-1f4f06df91a8 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.340817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.341813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.342206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.342581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.343758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.347930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.361000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:10.470448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1152/2295] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:10 2022] POST /identity/v3/projects => generated 399 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:00:10.476787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.498254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069805-c52d-4fbc-9776-12c314808e06 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.504371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:10.565706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.567091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.567466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.567986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.568899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.570821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.671750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1144/2296] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:10 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:10.676914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.688525 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57870-7340-4f76-b634-3d1cdef02c31 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.693631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.694378 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.694612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.694892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.695639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.697314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.713700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1153/2297] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:10.718218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.731850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d8ef-fc59-4676-b5db-a43b9c9bb089 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.739053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.740375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.740658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.740934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.741963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.743886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74358bc-9fc6-45b7-81cf-0cf140ddbcbc admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.759939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1145/2298] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:10.761293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:10.773958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f050-8787-4061-bda6-493edf179958 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:10.778723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:10.779619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.779939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.780218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] PATH_INFO: `/v3/projects/ba8508f3b5e44c9bb715a3173d1d0f62/users/d8f011f6c63745f2a87c303b00664ce2/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.796329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8508f3b5e44c9bb715a3173d1d0f62, user_id=d8f011f6c63745f2a87c303b00664ce2, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:10.799042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:10.872504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1154/2299] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:10 2022] PUT /identity/v3/projects/ba8508f3b5e44c9bb715a3173d1d0f62/users/d8f011f6c63745f2a87c303b00664ce2/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:10.885076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:10.885371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:10.885660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:10.915838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] MFA Rules not processed for user `d8f011f6c63745f2a87c303b00664ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:10.917084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:11.004675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1146/2300] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:11.012539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:11.014567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:11.084229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea04b-867d-466f-9419-7dccb5af2a9d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:11.088253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:11.088944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:11.089257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:11.089533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:11.100058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:11.101542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a623ca9-d889-47e4-b341-023ee3ab7f5a service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:11.114503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1155/2301] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:17.203613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:17.275869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d2a3-93ae-4634-a497-5660fc01d256 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:17.280403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:17.281284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:17.281571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:17.281848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] PATH_INFO: `/v3/users/d8f011f6c63745f2a87c303b00664ce2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:17.283075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f011f6c63745f2a87c303b00664ce2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:17.285626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:17.303955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:17.574224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f011f6c63745f2a87c303b00664ce2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:17.575004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f011f6c63745f2a87c303b00664ce2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:17.588688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f011f6c63745f2a87c303b00664ce2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:17.684971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f011f6c63745f2a87c303b00664ce2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:17.693594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f011f6c63745f2a87c303b00664ce2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:17.700059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1147/2302] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:17 2022] DELETE /identity/v3/users/d8f011f6c63745f2a87c303b00664ce2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:17.704758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:17.705232 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:17.705316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:17.724448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:17.725674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:17.794460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1156/2303] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:17.803153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:17.804639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:17.867714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0887b-3f50-4fc5-a5b1-7923d03e8df9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:17.871344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:17.874668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:17.874668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:17.874668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:17.882169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:17.883606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16517-027f-419b-b756-4d3cdaf9078c service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:17.893517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1148/2304] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:18.341737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:18.357575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:18.357575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e7d6e-188f-4a40-a516-887281e98f78 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:18.362414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:18.362543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:18.363539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:18.364098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] PATH_INFO: `/v3/projects/ba8508f3b5e44c9bb715a3173d1d0f62` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:18.365089 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8508f3b5e44c9bb715a3173d1d0f62)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:18.367358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:18.505127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8508f3b5e44c9bb715a3173d1d0f62', 'request_id': 'req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:18.508944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:18.596011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8508f3b5e44c9bb715a3173d1d0f62', 'request_id': 'req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:18.603321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8508f3b5e44c9bb715a3173d1d0f62', 'request_id': 'req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:18.614835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] The token cache is being invalidate because project ba8508f3b5e44c9bb715a3173d1d0f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:18.615154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:18.615843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:18.617405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1157/2305] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:18 2022] DELETE /identity/v3/projects/ba8508f3b5e44c9bb715a3173d1d0f62 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:20.533359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:20.536481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:20.536481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:20.551974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:20.553578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:20.616289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1149/2306] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:20.670995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:20.672479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:20.775278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded8ef-1d8f-45ef-b3ca-7db6f484042f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:20.780896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:20.781553 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:20.781836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:20.782113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:20.790857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:20.792489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999468-ecd3-4e5b-a9bb-328b1ba60e9d service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:20.805997 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1158/2307] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 15:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:30.609193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=9,keystone:SELECT=71,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:30.797529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:35.141761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:35.143268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:35.214803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863dc41-81fb-4e12-b423-8de9b0b4f197 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:35.218835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:35.219790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:35.220211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:35.220380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:35.227398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:35.319271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:35.320776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:35.332426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1150/2308] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:36.194941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:36.198837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:36.198837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:36.215559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:36.216906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:36.225147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1159/2309] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:36.239016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:36.251574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43e4e-f6ed-481f-9ea7-3dfd759c8d03 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:36.257503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:36.258169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:36.258456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:36.258783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:36.267931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:36.269592 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:36.278260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1151/2310] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 15:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 15:00:40.274629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:40.275102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:40.295265 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9086-6ed0-47ce-a950-6d2c90a3a36b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:40.300968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:40.301967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:40.302369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:40.302860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] PATH_INFO: `/v3/users/8177948cd6074d1f8240500be6bcd424` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:40.304809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8177948cd6074d1f8240500be6bcd424)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:40.306769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:40.488588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8177948cd6074d1f8240500be6bcd424'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:40.497008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8177948cd6074d1f8240500be6bcd424'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:40.497922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8177948cd6074d1f8240500be6bcd424'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:40.513331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8177948cd6074d1f8240500be6bcd424'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:40.514095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3c25d735-7439-497a-bbf3-6f13d9bd3f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8177948cd6074d1f8240500be6bcd424'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:40.578746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1160/2311] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:40 2022] DELETE /identity/v3/users/8177948cd6074d1f8240500be6bcd424 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:40.972649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:40.985024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be832b-e5e4-42e5-a86b-0ba7f8338e2f service swift] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:41.091909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:41.092860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.093141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.093415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] PATH_INFO: `/v3/projects/b2a6d6e288714256b0800fa7f9e27618` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.094638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a6d6e288714256b0800fa7f9e27618)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:41.096588 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:41.284387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:41.307914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a6d6e288714256b0800fa7f9e27618', 'request_id': 'req-0c198f03-e0bf-4a4e-b4d9-15308b664232'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.437373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a6d6e288714256b0800fa7f9e27618', 'request_id': 'req-0c198f03-e0bf-4a4e-b4d9-15308b664232'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.447930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a6d6e288714256b0800fa7f9e27618', 'request_id': 'req-0c198f03-e0bf-4a4e-b4d9-15308b664232'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.479534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] The token cache is being invalidate because project b2a6d6e288714256b0800fa7f9e27618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:41.480230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.481925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.487980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1152/2312] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:40 2022] DELETE /identity/v3/projects/b2a6d6e288714256b0800fa7f9e27618 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:41.489181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7fbd5-6d40-4150-9de6-3094588f1e0e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.489678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7fbd5-6d40-4150-9de6-3094588f1e0e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.489765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7fbd5-6d40-4150-9de6-3094588f1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.514235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-2fc7fbd5-6d40-4150-9de6-3094588f1e0e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:41.515551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2fc7fbd5-6d40-4150-9de6-3094588f1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:41.624518 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:41.626668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:41.649339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1161/2313] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:41.657529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.658009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.658515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.681442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:41.682669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:41.699915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1162/2314] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:41.701073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:41.710904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087cde-eb6b-4b84-a254-c1dcd8006c69 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:41.711262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c198f03-e0bf-4a4e-b4d9-15308b664232 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:41.716329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:41.716615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:41.722726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.722726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.722937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.723053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.723218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.723218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] PATH_INFO: `/v3/users/6b68981fa6fb42739b502c7b9424e655` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.723441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:00:41.723441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:41.723604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b68981fa6fb42739b502c7b9424e655)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:41.723695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:41.723797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:41.743771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1163/2315] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:00:41.744945 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:41.758600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509670e-ea01-4c87-ab52-c9941a4af3f7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:41.763411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:41.764152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:41.764697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:41.764911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:41.765614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:41.767531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:41.914311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1164/2316] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:41 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:41.919073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:41.958482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:41.970717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b68981fa6fb42739b502c7b9424e655'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.972118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b68981fa6fb42739b502c7b9424e655'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:41.988360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b68981fa6fb42739b502c7b9424e655'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:42.014355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192e1c-f369-46bf-926a-7d23ab574cd9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.023249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.024837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.025300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.026343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.027215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.029495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.096487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b68981fa6fb42739b502c7b9424e655'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:42.105749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-7e219ead-a5c2-4d7f-91e1-2f52ce6770f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b68981fa6fb42739b502c7b9424e655'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:42.112241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1153/2317] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:41 2022] DELETE /identity/v3/users/6b68981fa6fb42739b502c7b9424e655 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:42.117375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ef91-1150-447a-a54a-01348918a91a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.117659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ef91-1150-447a-a54a-01348918a91a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.117932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ef91-1150-447a-a54a-01348918a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.136519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b591ef91-1150-447a-a54a-01348918a91a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:42.142834 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b591ef91-1150-447a-a54a-01348918a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.154384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1165/2318] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:41 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:00:42.163450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.171451 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.200521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc182d-0e38-43dd-ac2c-bf110c826de9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.210971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:42.234162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1154/2319] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:42.246211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591ef91-1150-447a-a54a-01348918a91a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.248230 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b591ef91-1150-447a-a54a-01348918a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.270715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.271306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.271586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.271901 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.272640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.274365 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.285964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1166/2320] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:42.290160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.302091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e0b-fa34-46d6-b123-8b3788cd1adf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.308731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.309622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.313260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.313260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.313260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.313890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.331976 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591ef91-1150-447a-a54a-01348918a91a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.336249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1167/2321] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:42.337379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.340710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.343274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.343274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.343274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.348666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada339-3245-4ed2-8b0e-a795633e66c5 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.353582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.353778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.354485 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.354769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.355051 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] PATH_INFO: `/v3/projects/25f5695da9144a5cbc3892ec3e43616c/users/0d25c39055bc4df69e71f72d36cb1e58/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.355165 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c4ad5-e4ed-40d6-914d-fa2880fe6ad1 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.368750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1155/2322] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:42.374405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f5695da9144a5cbc3892ec3e43616c, user_id=0d25c39055bc4df69e71f72d36cb1e58, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.377287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.468896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1168/2323] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:42 2022] PUT /identity/v3/projects/25f5695da9144a5cbc3892ec3e43616c/users/0d25c39055bc4df69e71f72d36cb1e58/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:42.470761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.471314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.471611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.496254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:42.497577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.566928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1156/2324] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:42.581595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.666302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01d0d-d466-46b2-9e1e-bf8b3dd4609a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.670694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.671354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.671828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.672294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.683095 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.685172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.696795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1169/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:42.848705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.850418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.875101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9b97-4de1-4745-acfd-4d2cec1709d0 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.895894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.897334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.897873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.898374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] PATH_INFO: `/v3/projects/40be962134104b6fb4051d48ff145fc1` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.900971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40be962134104b6fb4051d48ff145fc1)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.903617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.925499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:42.927871 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.944486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6bca9-e803-4dd9-bafb-b8a81993ed28 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:42.967978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:42.968649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:42.969580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:42.969909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:42.972164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:42.984261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:42.988358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:42.996062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1170/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:00:43.041400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40be962134104b6fb4051d48ff145fc1', 'request_id': 'req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.159422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40be962134104b6fb4051d48ff145fc1', 'request_id': 'req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.167383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40be962134104b6fb4051d48ff145fc1', 'request_id': 'req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.182012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] The token cache is being invalidate because project 40be962134104b6fb4051d48ff145fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:43.182644 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.183876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-245253bc-3073-4aa3-b8cf-0ab8dc7bc878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.189135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1157/2327] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:42 2022] DELETE /identity/v3/projects/40be962134104b6fb4051d48ff145fc1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:43.191135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:43.199241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:43.204948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3c074-f723-42bb-b242-0c314932700a service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:43.298452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:43.300831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:43.304590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:43.304590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] PATH_INFO: `/v3/users/e8d28a309c13492db5220500734848a9` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:43.304590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d28a309c13492db5220500734848a9)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:43.306299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:43.496927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d28a309c13492db5220500734848a9'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.504576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d28a309c13492db5220500734848a9'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.505415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d28a309c13492db5220500734848a9'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.522607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d28a309c13492db5220500734848a9'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.522607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d28a309c13492db5220500734848a9'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:43.629279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1171/2328] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:43 2022] DELETE /identity/v3/users/e8d28a309c13492db5220500734848a9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:44.230859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.231397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.231577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.267400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:44.271454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] MFA Rules not processed for user `0d25c39055bc4df69e71f72d36cb1e58`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:44.272812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.330482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.332985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.398399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1158/2329] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:44.409799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.411712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.461932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbd32-f4d0-49b0-a2b5-94b229bf8d54 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.472273 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.475091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.475458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.478757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] PATH_INFO: `/v3/projects/293a5cf3f9c04d64826ca241a450da43` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.480385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] RBAC: Authorizing `identity:delete_project(project_id=293a5cf3f9c04d64826ca241a450da43)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.483348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:44.517683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71b9c-75e4-4cc4-81e8-3cae4918c3ed None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.526090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.527372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.527735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.528423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.529347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.533233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:44.599299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:44.619311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293a5cf3f9c04d64826ca241a450da43', 'request_id': 'req-5523d050-630b-4469-a745-8ff2b01f608c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:44.634333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1159/2330] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/projects => generated 405 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:44.638356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.742693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293a5cf3f9c04d64826ca241a450da43', 'request_id': 'req-5523d050-630b-4469-a745-8ff2b01f608c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:44.747111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ba276-2630-44bf-919a-20dfe81ae62d admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.753611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.754474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293a5cf3f9c04d64826ca241a450da43', 'request_id': 'req-5523d050-630b-4469-a745-8ff2b01f608c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:44.754635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.754911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.755260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.756271 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.759265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:44.788510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] The token cache is being invalidate because project 293a5cf3f9c04d64826ca241a450da43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:44.793445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:44.795428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5523d050-630b-4469-a745-8ff2b01f608c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:44.797521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1172/2331] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:44 2022] DELETE /identity/v3/projects/293a5cf3f9c04d64826ca241a450da43 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:44.803853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7a45-dc3b-44fc-9fc5-6b94a5378012 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.804403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7a45-dc3b-44fc-9fc5-6b94a5378012 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.804873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7a45-dc3b-44fc-9fc5-6b94a5378012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.833154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0fda7a45-dc3b-44fc-9fc5-6b94a5378012 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:44.835233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0fda7a45-dc3b-44fc-9fc5-6b94a5378012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.846439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1173/2332] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:44.854821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.855402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.855870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.880530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:44.882223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.894406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1174/2333] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:44.898941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.912312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184fcf-22d6-4a29-b515-24e647366ca9 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.920079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.921220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.921671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.922211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.923478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:00:44.924598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.927349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:44.931850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1160/2334] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/users => generated 309 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:44.935852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.937667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:44.945302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1175/2335] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:00:44.950384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:44.961852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fd8d-dea4-4932-9133-8bef4da9513f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.962629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a1a51-39a9-4961-8c47-94493af08bb2 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:44.968233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.968933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.973246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.973246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.973246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.973246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:44.978961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:44.979665 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:44.980511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:44.980511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:44.981019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:44.982677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.009865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1161/2336] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:45.013979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.025935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b54e4-2f7a-496b-b470-ffb7fe51eaae admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.031028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.031994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.032261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.032539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] PATH_INFO: `/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b/users/94aae4e6307943b39038afaeb05f9ee7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.052176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c1daeaf3c94a7eb833a48e1ccb611b, user_id=94aae4e6307943b39038afaeb05f9ee7, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.055105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.115400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1176/2337] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:44 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:45.116496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.146429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1162/2338] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:45 2022] PUT /identity/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b/users/94aae4e6307943b39038afaeb05f9ee7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:45.150936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.198228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470890-b895-4391-ac9b-cfda09ce5f4b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.233761 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7077bc-639b-4af6-9b1b-396fca7e7b84 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.243678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.244859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.245152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.245781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.246551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.248225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.270762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1163/2339] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:45.275266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.280462 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.281036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.281322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.281676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.282384 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.284849 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.296472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cbee-9936-4a83-9db5-255100d04974 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.309693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.310794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.311147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.311490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] PATH_INFO: `/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b/users/94aae4e6307943b39038afaeb05f9ee7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.314118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c1daeaf3c94a7eb833a48e1ccb611b, user_id=94aae4e6307943b39038afaeb05f9ee7, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.317946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.337750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1164/2340] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:45 2022] PUT /identity/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b/users/94aae4e6307943b39038afaeb05f9ee7/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:45.387442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1177/2341] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:45 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:45.388519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.455636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10190-9546-420a-b4a9-a2e994b1f4c5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.461192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.461874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.462155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.462434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.463447 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.465022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.475620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1165/2342] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:45.479604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.489925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31be6-2dd9-4157-95bd-d92d06df5736 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.495757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.496613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.496972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.497316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.498120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.500005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f56c5-27c2-4cc5-9932-30c9838e860b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.515129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1178/2343] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:45.520067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.531760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9144-4ae9-42e5-a8cd-3a764f97b46c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.538093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.539081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.539432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.539814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] PATH_INFO: `/v3/projects/3e946b1489f54211b4270df2cc6a06fa/users/199b460a22c849b5b8a9e35db8532045/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.557656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e946b1489f54211b4270df2cc6a06fa, user_id=199b460a22c849b5b8a9e35db8532045, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.560740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:45.653390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1166/2344] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:45 2022] PUT /identity/v3/projects/3e946b1489f54211b4270df2cc6a06fa/users/199b460a22c849b5b8a9e35db8532045/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:45.667085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.667373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.667651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.706361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] MFA Rules not processed for user `199b460a22c849b5b8a9e35db8532045`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:45.708220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:45.823595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1179/2345] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:45.828193 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:45.836764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:45.926968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c385-f186-47df-b097-0b6e6bf6e063 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:45.932196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:45.933122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:45.933813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:45.934232 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:45.936225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:45.938565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.058988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1167/2346] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:45 2022] POST /identity/v3/projects => generated 363 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:46.063086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.075868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655206-d2f8-4c56-948c-96d4abce38b5 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.168286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.169219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.169576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.170309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.171119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.173481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.287678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1180/2347] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:46 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:46.291754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.306795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03ec9-9b93-4692-9198-45dcb95ac053 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.309198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.309950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.310314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.310823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.311715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.313498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.325565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1168/2348] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:46.329931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.340698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190010ba-e031-44fc-a72f-9b63b1a633d6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.347183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.348129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.349140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.349445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] PATH_INFO: `/v3/projects/991291b76b7041b695ea3ddfb8c77736/users/b92e50ccae224c50abbba33a45848b70/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.369529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] RBAC: Authorizing `identity:create_grant(project_id=991291b76b7041b695ea3ddfb8c77736, user_id=b92e50ccae224c50abbba33a45848b70, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.375124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.475463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1181/2349] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:46 2022] PUT /identity/v3/projects/991291b76b7041b695ea3ddfb8c77736/users/b92e50ccae224c50abbba33a45848b70/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:46.479486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.494257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d71e-d326-4c64-bb85-e7d504ce5844 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.559685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.562301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.562301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.562301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.562301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.563301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086eb880-d457-4c08-b901-113cf9665160 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.576043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1169/2350] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:46.580234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.604184 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085439d4-98f8-42b4-9e36-4ab8de28903f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.611774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.613563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.614011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.614357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] PATH_INFO: `/v3/projects/991291b76b7041b695ea3ddfb8c77736/users/b92e50ccae224c50abbba33a45848b70/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.618044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=991291b76b7041b695ea3ddfb8c77736, user_id=b92e50ccae224c50abbba33a45848b70, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.623426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ba239-c91e-4f97-9d15-c90b7d53e5cb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.643864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1182/2351] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:46 2022] PUT /identity/v3/projects/991291b76b7041b695ea3ddfb8c77736/users/b92e50ccae224c50abbba33a45848b70/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:46.650671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.650936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.651593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.679532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:46.685798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] MFA Rules not processed for user `b92e50ccae224c50abbba33a45848b70`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:46.689775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:46.774421 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.774716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.775008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.786325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1170/2352] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:46.803675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.805214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:46.810847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:46.812783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:46.850246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:46.883196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936281a-8626-4674-a05a-51f30c2b35c1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:46.888530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:46.889606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:46.889911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:46.890171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:46.894881 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1183/2353] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jun 15 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:46.903733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:46.905300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162ab8-e951-4c96-8998-d249d5c9ff99 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:46.913155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:46.916021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:46.918970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1171/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:00:47.022172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209438d0-df39-4b42-8da5-0ff7c1add71b None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:47.028178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:47.028850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:47.029132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:47.029406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:47.039766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:47.041657 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:47.050836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1184/2355] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 15:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:47.298389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:47.300561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:47.301295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:47.423360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] MFA Rules not processed for user `94aae4e6307943b39038afaeb05f9ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:47.423360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:47.462567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:47.464754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:47.658061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1172/2356] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:47.668809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec3d8-e433-4ca6-aef8-d7e919d68838 service swift] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:47.679316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:47.693303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:47.693303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:47.693303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:47.693303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:47.696197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:47.698645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:47.716038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:47.718625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:47.743466 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1185/2357] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:47.841470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ca53-6412-43ab-8c42-6674b90a16a5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:47.846100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:47.847129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:47.847395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:47.847891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] PATH_INFO: `/v3/users/7a5e087e2e3841e68414cff4ec2cf569` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:47.849138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5e087e2e3841e68414cff4ec2cf569)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:47.854907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:48.096374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5e087e2e3841e68414cff4ec2cf569'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.098077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5e087e2e3841e68414cff4ec2cf569'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.129567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5e087e2e3841e68414cff4ec2cf569'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.167306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:48.224563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5e087e2e3841e68414cff4ec2cf569'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.233659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5e087e2e3841e68414cff4ec2cf569'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.244637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:48.255200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1173/2358] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:47 2022] DELETE /identity/v3/users/7a5e087e2e3841e68414cff4ec2cf569 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:48.273640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15c2c9-9276-4a77-ae0d-5ce192236a11 service placement] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:48.383879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:48.385589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:48.386106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:48.386479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] PATH_INFO: `/v3/users/199b460a22c849b5b8a9e35db8532045` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:48.400550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199b460a22c849b5b8a9e35db8532045)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:48.400550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:48.542435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:48.609659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199b460a22c849b5b8a9e35db8532045'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.617762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199b460a22c849b5b8a9e35db8532045'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.618604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199b460a22c849b5b8a9e35db8532045'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.651833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:48.653038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199b460a22c849b5b8a9e35db8532045'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.653544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:48.653983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6fc35f64-9290-4d15-bcba-2e2abedef496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199b460a22c849b5b8a9e35db8532045'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.672214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1232d3-1de6-4cf6-814d-fc84ef90eb46 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:48.682066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:48.684156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:48.684610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:48.685046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] PATH_INFO: `/v3/projects/37ff36dd761d426994c9cf4b9c6adad9` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:48.686565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ff36dd761d426994c9cf4b9c6adad9)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:48.689323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:48.779290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1186/2359] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:48 2022] DELETE /identity/v3/users/199b460a22c849b5b8a9e35db8532045 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:48.783892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:48.784987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:48.785460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:48.811792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:48.813087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:48.917752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ff36dd761d426994c9cf4b9c6adad9', 'request_id': 'req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:48.930890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1187/2360] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:48.954873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:48.959982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:49.013144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ff36dd761d426994c9cf4b9c6adad9', 'request_id': 'req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.021204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ff36dd761d426994c9cf4b9c6adad9', 'request_id': 'req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.047334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] The token cache is being invalidate because project 37ff36dd761d426994c9cf4b9c6adad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:49.048020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.048745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.050523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1174/2361] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:48 2022] DELETE /identity/v3/projects/37ff36dd761d426994c9cf4b9c6adad9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:49.054682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:49.056199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:49.082067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270211e-bc2f-4fc2-a4e8-c30766419692 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:49.159861 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4f65-1fb2-4550-83d6-07ea86667ac4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:49.172957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:49.176371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:49.176958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:49.178278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] PATH_INFO: `/v3/users/72c3750bc368418382623db4b9f5aa8d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:49.180917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c3750bc368418382623db4b9f5aa8d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:49.186266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:49.233776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:49.234689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:49.234832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:49.235133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:49.238298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:49.245617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:49.254101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:49.255632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:49.267620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1188/2362] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:00:49.446277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c3750bc368418382623db4b9f5aa8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.446898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c3750bc368418382623db4b9f5aa8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.476661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c3750bc368418382623db4b9f5aa8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.582239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c3750bc368418382623db4b9f5aa8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.590907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c3750bc368418382623db4b9f5aa8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:49.604084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1175/2363] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:49 2022] DELETE /identity/v3/users/72c3750bc368418382623db4b9f5aa8d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:49.699103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:49.880827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:49.883084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:49.907682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf914-4979-474f-889b-401c00d72dd5 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:49.994965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:49.997224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:50.064779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:50.065744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:50.066005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:50.066280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] PATH_INFO: `/v3/users/0d25c39055bc4df69e71f72d36cb1e58` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:50.067510 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d25c39055bc4df69e71f72d36cb1e58)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:50.069552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:50.141084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a469e-fd72-4d22-8f06-3a832967ab76 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:50.158209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:50.161116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:50.161387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:50.161663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] PATH_INFO: `/v3/projects/3e946b1489f54211b4270df2cc6a06fa` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:50.168094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e946b1489f54211b4270df2cc6a06fa)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:50.168094 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:50.194580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:50.356328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:50.363336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d25c39055bc4df69e71f72d36cb1e58'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.371065 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d25c39055bc4df69e71f72d36cb1e58'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.372222 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d25c39055bc4df69e71f72d36cb1e58'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.373196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e946b1489f54211b4270df2cc6a06fa', 'request_id': 'req-6158223b-5421-4ec4-89b7-410becfba05d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.389330 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d25c39055bc4df69e71f72d36cb1e58'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.402686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d25c39055bc4df69e71f72d36cb1e58'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.476176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e946b1489f54211b4270df2cc6a06fa', 'request_id': 'req-6158223b-5421-4ec4-89b7-410becfba05d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.483772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e946b1489f54211b4270df2cc6a06fa', 'request_id': 'req-6158223b-5421-4ec4-89b7-410becfba05d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.499833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] The token cache is being invalidate because project 3e946b1489f54211b4270df2cc6a06fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:50.500649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.501744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.504878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1176/2364] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:49 2022] DELETE /identity/v3/projects/3e946b1489f54211b4270df2cc6a06fa => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:50.508627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:50.510053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:50.568388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1189/2365] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:49 2022] DELETE /identity/v3/users/0d25c39055bc4df69e71f72d36cb1e58 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:50.569323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:50.570731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:50.583324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158223b-5421-4ec4-89b7-410becfba05d admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:50.663161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:50.664251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:50.664506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:50.664789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] PATH_INFO: `/v3/projects/e8f8202263f446a88bdee467ad5c26d8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:50.666057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f8202263f446a88bdee467ad5c26d8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:50.668041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:50.704383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10b3c-033f-47c0-a475-2da8c3ef05a9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:50.711353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:50.712629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:50.713137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:50.713605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] PATH_INFO: `/v3/users/b92e50ccae224c50abbba33a45848b70` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:50.715210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92e50ccae224c50abbba33a45848b70)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:50.717647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:50.785482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f8202263f446a88bdee467ad5c26d8', 'request_id': 'req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.870111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f8202263f446a88bdee467ad5c26d8', 'request_id': 'req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.877627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f8202263f446a88bdee467ad5c26d8', 'request_id': 'req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.890383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] The token cache is being invalidate because project e8f8202263f446a88bdee467ad5c26d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:50.890802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.891667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:50.894200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1177/2366] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:50 2022] DELETE /identity/v3/projects/e8f8202263f446a88bdee467ad5c26d8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:50.965562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:50.967681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:51.033366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92e50ccae224c50abbba33a45848b70'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.055264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92e50ccae224c50abbba33a45848b70'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.056728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92e50ccae224c50abbba33a45848b70'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.072591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92e50ccae224c50abbba33a45848b70'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.073355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92e50ccae224c50abbba33a45848b70'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.128931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e686c-bdd3-424a-87f5-c8f6a715fe52 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:51.140314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:51.141222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:51.141509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:51.141783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] PATH_INFO: `/v3/projects/25f5695da9144a5cbc3892ec3e43616c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:51.143053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f5695da9144a5cbc3892ec3e43616c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:51.145590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:51.162886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1190/2367] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:50 2022] DELETE /identity/v3/users/b92e50ccae224c50abbba33a45848b70 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:51.282251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f5695da9144a5cbc3892ec3e43616c', 'request_id': 'req-cf6195e2-210a-40dc-872e-031c1045f271'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.386264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f5695da9144a5cbc3892ec3e43616c', 'request_id': 'req-cf6195e2-210a-40dc-872e-031c1045f271'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.388290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:51.404509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f5695da9144a5cbc3892ec3e43616c', 'request_id': 'req-cf6195e2-210a-40dc-872e-031c1045f271'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.429323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] The token cache is being invalidate because project 25f5695da9144a5cbc3892ec3e43616c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:51.429658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.431101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.433089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1178/2368] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:50 2022] DELETE /identity/v3/projects/25f5695da9144a5cbc3892ec3e43616c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:51.437830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:51.440182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:51.520585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7b99-ed81-4dea-9815-ac5f471f5295 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:51.555986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:51.610547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:51.611426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:51.611704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:51.612018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] PATH_INFO: `/v3/users/94aae4e6307943b39038afaeb05f9ee7` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:51.613935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94aae4e6307943b39038afaeb05f9ee7)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:51.616055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:51.713070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:51.714842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:51.733716 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6195e2-210a-40dc-872e-031c1045f271 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:51.739544 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:51.740483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:51.740773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:51.741077 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] PATH_INFO: `/v3/projects/991291b76b7041b695ea3ddfb8c77736` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:51.742340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991291b76b7041b695ea3ddfb8c77736)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:51.744535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:51.792953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94aae4e6307943b39038afaeb05f9ee7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.801533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94aae4e6307943b39038afaeb05f9ee7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.802437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94aae4e6307943b39038afaeb05f9ee7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.816520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94aae4e6307943b39038afaeb05f9ee7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.817247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-e3aea729-310b-43f7-870d-5caf8ae49f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94aae4e6307943b39038afaeb05f9ee7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.868014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991291b76b7041b695ea3ddfb8c77736', 'request_id': 'req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.902251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1191/2369] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:00:51 2022] DELETE /identity/v3/users/94aae4e6307943b39038afaeb05f9ee7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:51.978491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991291b76b7041b695ea3ddfb8c77736', 'request_id': 'req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.990050 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991291b76b7041b695ea3ddfb8c77736', 'request_id': 'req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:51.999518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:52.005091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] The token cache is being invalidate because project 991291b76b7041b695ea3ddfb8c77736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:52.005696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.006183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c4ebde21-829a-4fe2-94ef-d4b3d50d6706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.008404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1179/2370] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:51 2022] DELETE /identity/v3/projects/991291b76b7041b695ea3ddfb8c77736 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:52.013339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.013892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.014240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.051572 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:52.067322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:52.068651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.170062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1192/2371] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:52.179339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.180241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.180745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.204816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:52.206096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.214557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1180/2372] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:52.218978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.230187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90012-0053-43a8-ac67-061193fd5e22 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.235257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.235953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.240261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.240261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.240261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:00:52.240261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.240261 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.252679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1193/2373] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:00:52.258414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.276884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21a3b-96f3-4197-8da4-13744a27b466 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.277067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.277807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.280713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.281001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.281001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.281001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.281001 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.282618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.304158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267110d-63e6-4d52-97f1-75928846642c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.310408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.311340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.311669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.312007 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] PATH_INFO: `/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.313217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c1daeaf3c94a7eb833a48e1ccb611b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.315176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.374919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1181/2374] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:00:52.379637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.421724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c1daeaf3c94a7eb833a48e1ccb611b', 'request_id': 'req-524b7a7d-0822-452e-8a12-1f6c839a57a8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.469984 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2916-988e-435c-9013-0d263b3249c1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.532909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c1daeaf3c94a7eb833a48e1ccb611b', 'request_id': 'req-524b7a7d-0822-452e-8a12-1f6c839a57a8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.542410 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c1daeaf3c94a7eb833a48e1ccb611b', 'request_id': 'req-524b7a7d-0822-452e-8a12-1f6c839a57a8'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.563834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] The token cache is being invalidate because project a4c1daeaf3c94a7eb833a48e1ccb611b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:00:52.564808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.567197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-524b7a7d-0822-452e-8a12-1f6c839a57a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:00:52.573630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1194/2375] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:00:52 2022] DELETE /identity/v3/projects/a4c1daeaf3c94a7eb833a48e1ccb611b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:52.586328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e2e1-ed40-494d-b892-b141720ff40d None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.586328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e2e1-ed40-494d-b892-b141720ff40d None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.586328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e2e1-ed40-494d-b892-b141720ff40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.586906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.586906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.586906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.586906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.587298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.587298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.611217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-31f0e2e1-ed40-494d-b892-b141720ff40d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:52.613382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-31f0e2e1-ed40-494d-b892-b141720ff40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.626970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1195/2376] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:52.636440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.636727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.637005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.639399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:52.645050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:52.661027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:52.662521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.700335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1196/2377] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:00:52.701409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.705528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1182/2378] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:52.713096 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab60a2-7242-480a-b550-f41087bb4913 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.721059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.724088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:52.729994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.731209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.731493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.731768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.732561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:00:52.736058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.738641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.748509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c04a0-74f3-48a8-a353-67103463da84 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.763881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.764584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.765396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.765686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.767262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.773864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.779853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1197/2379] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:00:52.779853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.790910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dc491-7dd6-4bbf-9107-8448d818cdde admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.796335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1183/2380] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:52.800586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.802017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.802858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.803919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.804904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.808947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.810908 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.816054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9fb13-7aff-45c1-81b3-fa567307fa68 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.827655 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.830043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.831963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.832464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.834991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.838285 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.854318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1184/2381] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:52.858557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.870922 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e352-4a84-4040-af7c-4f5bd70fb3a4 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:52.876534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:52.877679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.878002 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.878457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] PATH_INFO: `/v3/projects/29d6413e11944208b571b842f5e70147/users/bb6c0076f23d4f258120164da7c7f0d4/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:52.900283 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d6413e11944208b571b842f5e70147, user_id=bb6c0076f23d4f258120164da7c7f0d4, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:52.903056 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb9f3f-1548-4e74-9d1f-43b2fa667612 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:52.921130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1198/2382] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:52.926799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:52.974576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1185/2383] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:52 2022] PUT /identity/v3/projects/29d6413e11944208b571b842f5e70147/users/bb6c0076f23d4f258120164da7c7f0d4/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:52.986289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:52.986289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:52.986611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.010958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f7f04-abc9-4ba5-a296-34690e54e03d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.050825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] MFA Rules not processed for user `bb6c0076f23d4f258120164da7c7f0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:53.052405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:53.090696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.091385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.091667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.092062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.093041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.095009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.153313 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1186/2384] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:53.161093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.172555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ad98e-f159-4b4e-bb31-a5cd5406df3a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.178462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.179222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.179508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.180151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.180789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.182980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.205724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1199/2385] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:52 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:53.207996 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.218836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19e18-a742-45d8-9026-284e9ba43a4f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.224629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.225306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.225591 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.225875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.226604 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.228331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.243904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1200/2386] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:53.244973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.257380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8a97b-249e-42ff-b0a9-ff6e5b4c4664 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.261983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.262885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.263209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.263492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.264403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.266823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.281530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1201/2387] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:53.283671 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1187/2388] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:53 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:53.288176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.288334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.303988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea5be5-1143-4732-bd5f-a5071117c7e6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.345072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:53.368702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:53.380582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.381967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.382438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.382876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] PATH_INFO: `/v3/projects/8eb6636584724ee18d6c039a6616928c/users/f5d8907c198c4cec903d4d6f0a6a32e7/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.384053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa9c4-a8c3-467d-8f8b-a2550a9e8a2a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.391691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.392561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.392950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.393400 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.396205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.398579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.403587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb6636584724ee18d6c039a6616928c, user_id=f5d8907c198c4cec903d4d6f0a6a32e7, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.406558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00e17d-ef58-43ff-bf33-031d28de4396 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.480062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1188/2389] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:53 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:53.487651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.497100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1202/2390] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:53 2022] PUT /identity/v3/projects/8eb6636584724ee18d6c039a6616928c/users/f5d8907c198c4cec903d4d6f0a6a32e7/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:53.515523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.515832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.516152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.526138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12209d2c-40f0-4bd2-829b-09bf3d7e626a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.549083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] MFA Rules not processed for user `f5d8907c198c4cec903d4d6f0a6a32e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:53.551456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:53.629529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.630211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.630497 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.630775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.631512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.634093 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.642860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1203/2391] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:53.647933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1189/2392] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:53.648091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.651564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.663953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84664-c10d-41d5-a39a-70728a3dec67 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.665220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583dd23-4826-4360-aecc-40ec459f46ee None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:53.669571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.670633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.670917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.671308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] PATH_INFO: `/v3/projects/a8fb48b41ab74758a47b197092e00ea0/users/c0e8a6abebaa4fcabb041e752eb8c4ae/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.677931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:53.678611 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:53.678954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:53.679176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:53.679907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.681800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.692172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fb48b41ab74758a47b197092e00ea0, user_id=c0e8a6abebaa4fcabb041e752eb8c4ae, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:53.695177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:53.818943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1190/2393] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:53 2022] PUT /identity/v3/projects/a8fb48b41ab74758a47b197092e00ea0/users/c0e8a6abebaa4fcabb041e752eb8c4ae/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:53.823220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.848905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1204/2394] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:00:53 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:00:53.852954 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:53.954333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e864-c3fc-4549-b0ec-e9553dbf9dbf admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.012562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e046d3-e66b-461a-af75-4452f9f7151d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.018151 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.019189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.019641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.020046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.020880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.023614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.061913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.062730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.063085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.063407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.064264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.066802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.069308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:54.090340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1191/2395] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:54.095058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.107467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1205/2396] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:00:53 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:00:54.111448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.119485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeaa97-46c3-4962-97cc-7e5476b00d5d admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.128738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.131057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.131354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.131473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971d03-8770-4f3f-89dd-acb5261a5785 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.131637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] PATH_INFO: `/v3/projects/a8fb48b41ab74758a47b197092e00ea0/users/c0e8a6abebaa4fcabb041e752eb8c4ae/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.138512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.139453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.139943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.140374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.140679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fb48b41ab74758a47b197092e00ea0, user_id=c0e8a6abebaa4fcabb041e752eb8c4ae, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.141435 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.143350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.143619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dbddd-0a4d-47b2-90e3-45e61637e415 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.156888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1206/2397] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:00:54.163225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.176793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1192/2398] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:54 2022] PUT /identity/v3/projects/a8fb48b41ab74758a47b197092e00ea0/users/c0e8a6abebaa4fcabb041e752eb8c4ae/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:00:54.188683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.190464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.192276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.197038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea499-8636-4122-bdca-b1c7743ad06f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.214664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:54.284763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] MFA Rules not processed for user `c0e8a6abebaa4fcabb041e752eb8c4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:54.286556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:54.339904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.340853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.341141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.341418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] PATH_INFO: `/v3/projects/63deca0b36d24d398fd8df08211b3eff/users/2829af844b6340208e3701868c57ce7a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.378071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63deca0b36d24d398fd8df08211b3eff, user_id=2829af844b6340208e3701868c57ce7a, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.381206 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.415926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1193/2399] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:54.424727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.427567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:54.480749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1207/2400] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:54 2022] PUT /identity/v3/projects/63deca0b36d24d398fd8df08211b3eff/users/2829af844b6340208e3701868c57ce7a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:54.500540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.555749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4028cfb-61b7-4857-abbc-868bac5bc63c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.581139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53a8f2-3623-475b-b78a-c731fe15421e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.587671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.589179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.589630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.603557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.603557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.603557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.607212 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1208/2401] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:00:54.611622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.623171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d006a-3ab9-4e88-a03c-7fcc26ab86a7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.629544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.630705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.631097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.631478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] PATH_INFO: `/v3/projects/63deca0b36d24d398fd8df08211b3eff/users/2829af844b6340208e3701868c57ce7a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.634782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63deca0b36d24d398fd8df08211b3eff, user_id=2829af844b6340208e3701868c57ce7a, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.637635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c98c8-f980-4f35-90e0-75f582bb1b93 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.638894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.639610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.639942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.640383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.650982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1209/2402] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:00:54 2022] PUT /identity/v3/projects/63deca0b36d24d398fd8df08211b3eff/users/2829af844b6340208e3701868c57ce7a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:00:54.667789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.669044 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.669386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.701919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:54.745495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] MFA Rules not processed for user `2829af844b6340208e3701868c57ce7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:00:54.747689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:54.774717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.781427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:54.812224 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1194/2403] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:00:54.857180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:54.864254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1210/2404] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:00:54.876733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:54.885557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:00:54.890213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27a7ab-3978-4f3f-ba26-2b5539caf5f7 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:54.969807 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:54.970474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:54.970814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:54.971156 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:54.986396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:54.993695 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:55.001562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1195/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:55.021685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:55.032211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834a3fe-4c5f-43d5-87b3-a6290fb56219 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:55.036781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:55.037482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:55.037763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:55.038060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:55.128141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:55.129610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:55.140620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1211/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:00:55.370368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:00:55.384930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767361-2855-4924-baf2-4e064e0c2089 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:00:55.406543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:00:55.407211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:00:55.407547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:00:55.407858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:00:55.483395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:00:55.484891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81332-33d6-483f-a491-dc3ae1697009 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:00:55.499345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1196/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:02.019910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:02.098825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f48f-cf4b-42f5-88d9-bc5d14aee210 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:02.103774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:02.104712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:02.104995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:02.105278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] PATH_INFO: `/v3/users/bb6c0076f23d4f258120164da7c7f0d4` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:02.106645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6c0076f23d4f258120164da7c7f0d4)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:02.108625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:02.359256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6c0076f23d4f258120164da7c7f0d4'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:02.367047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6c0076f23d4f258120164da7c7f0d4'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:02.367946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6c0076f23d4f258120164da7c7f0d4'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:02.382821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6c0076f23d4f258120164da7c7f0d4'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:02.383639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6c0076f23d4f258120164da7c7f0d4'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:02.513695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1212/2408] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:02 2022] DELETE /identity/v3/users/bb6c0076f23d4f258120164da7c7f0d4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:02.518363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:02.521582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:02.521582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:02.538919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:02.540184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:02.620628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1197/2409] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:02.631014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:02.632627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:02.652412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:02.691672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb1dd-4bf9-4ccb-a5b8-3ae6ed20c1cd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:02.695321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:02.696000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:02.696283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:02.696651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:02.705613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:02.707721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15251d06-0e57-451f-9882-7c1ccf4a4a71 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:02.717631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1213/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:03.201278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:03.201278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:03.214185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582b0b2-aa01-4993-b23f-6ae2e18c1cc2 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:03.219073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:03.220105 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:03.224089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:03.224089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] PATH_INFO: `/v3/projects/29d6413e11944208b571b842f5e70147` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:03.224089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d6413e11944208b571b842f5e70147)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:03.225261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:03.237081 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:03.281855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:03.282371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:03.282491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:03.301709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] MFA Rules not processed for user `5ce3d2e9dc934c84b40ceec3903fccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:03.303003 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:03.358899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1214/2411] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jun 15 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:03.373059 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:03.373917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d6413e11944208b571b842f5e70147', 'request_id': 'req-aca51ed5-6d5f-4384-8a28-270e3cd0e896'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.374520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:03.444630 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d6413e11944208b571b842f5e70147', 'request_id': 'req-aca51ed5-6d5f-4384-8a28-270e3cd0e896'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.449227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35835e-7757-4758-a5ac-db06e606c722 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:03.453538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d6413e11944208b571b842f5e70147', 'request_id': 'req-aca51ed5-6d5f-4384-8a28-270e3cd0e896'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.471989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] The token cache is being invalidate because project 29d6413e11944208b571b842f5e70147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:03.471989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.475464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.478762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1198/2412] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:03 2022] DELETE /identity/v3/projects/29d6413e11944208b571b842f5e70147 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:03.484372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:03.487333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:03.526841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4d5d5ee8b54056b747948ee0aa4b7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:03.527143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:03.527445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:03.527711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:03.529685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:03.539061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:03.595638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51ed5-6d5f-4384-8a28-270e3cd0e896 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:03.595638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:03.595638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:03.595638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:03.596726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] PATH_INFO: `/v3/users/c0e8a6abebaa4fcabb041e752eb8c4ae` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:03.596726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e8a6abebaa4fcabb041e752eb8c4ae)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:03.599853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:03.612388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:03.614923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:03.624622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1215/2413] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jun 15 15:01:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:03.856461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e8a6abebaa4fcabb041e752eb8c4ae'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.857120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e8a6abebaa4fcabb041e752eb8c4ae'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.872028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e8a6abebaa4fcabb041e752eb8c4ae'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:03.996121 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e8a6abebaa4fcabb041e752eb8c4ae'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.004883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9bdc5831-fc05-4d3e-ac09-abc4eeb18421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e8a6abebaa4fcabb041e752eb8c4ae'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.011681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1199/2414] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:03 2022] DELETE /identity/v3/users/c0e8a6abebaa4fcabb041e752eb8c4ae => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:04.604479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:04.618640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62b-ddc4-433a-8d07-8464b923cede service swift] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:04.689889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:04.690770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:04.691143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:04.692073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] PATH_INFO: `/v3/projects/a8fb48b41ab74758a47b197092e00ea0` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:04.694530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fb48b41ab74758a47b197092e00ea0)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:04.696626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:04.890793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fb48b41ab74758a47b197092e00ea0', 'request_id': 'req-2dea6232-9334-4697-8c6f-6dc593333ff0'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.967160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fb48b41ab74758a47b197092e00ea0', 'request_id': 'req-2dea6232-9334-4697-8c6f-6dc593333ff0'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.974179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fb48b41ab74758a47b197092e00ea0', 'request_id': 'req-2dea6232-9334-4697-8c6f-6dc593333ff0'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.984698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] The token cache is being invalidate because project a8fb48b41ab74758a47b197092e00ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:04.984985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.985621 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2dea6232-9334-4697-8c6f-6dc593333ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:04.987166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1216/2415] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:04 2022] DELETE /identity/v3/projects/a8fb48b41ab74758a47b197092e00ea0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:04.992929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:04.993389 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:04.993483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.012471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:05.013708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.027754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:05.080733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1200/2416] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:05.088984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.089345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.089602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.113783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:05.115907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.124566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1217/2417] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:05.128794 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.139559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a39f0-d1a5-4d65-a2fc-0551d8085f1b None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.144702 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75003-0064-417a-a081-546079933c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.145371 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75003-0064-417a-a081-546079933c75 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.145795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75003-0064-417a-a081-546079933c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.146143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75003-0064-417a-a081-546079933c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.146821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75003-0064-417a-a081-546079933c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:05.147139 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75003-0064-417a-a081-546079933c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.148787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75003-0064-417a-a081-546079933c75 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.161005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1201/2418] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:05.165424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.175736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb37a66-bbf2-4d9b-8b51-21e85e1d2106 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.181334 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.182016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.182308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.182580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.183574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.186103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.309923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1218/2419] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:05 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:05.314221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75003-0064-417a-a081-546079933c75 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.325217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75003-0064-417a-a081-546079933c75 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.406406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.407204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.407584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.421757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.421757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.421757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.519397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.521303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.533942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6962c-bc93-4ab1-b875-d29f9ee3e02d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.539356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.540026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1202/2420] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:05 2022] POST /identity/v3/users => generated 280 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:05.540875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.541112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.541213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.541447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] PATH_INFO: `/v3/users/f5d8907c198c4cec903d4d6f0a6a32e7` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.542656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d8907c198c4cec903d4d6f0a6a32e7)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.544641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.547484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:05.552899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac3f1-5734-41ec-b0b0-2ca19a18e1e3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.557928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.559847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.559847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.559847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.560244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.561848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.575908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1203/2421] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:05.576990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.586858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d3dc6-40ff-4e41-b546-9a44dfb64eff admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.591430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.594431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.594431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.594431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.594431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.594862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.605806 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1204/2422] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:05.610003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.620546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfc9d7-f384-43b6-8110-ca4d94471402 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.625221 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.628944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.628944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.628944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] PATH_INFO: `/v3/projects/d166928b415c4077ba4bdc4315ea95dc/users/ef8b7b6f8a534985b2d33b85fde3076b/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.643298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d166928b415c4077ba4bdc4315ea95dc, user_id=ef8b7b6f8a534985b2d33b85fde3076b, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:05.646145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aaf38-5fb8-4648-b0c2-7f830be91e0e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:05.736678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1205/2423] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:05 2022] PUT /identity/v3/projects/d166928b415c4077ba4bdc4315ea95dc/users/ef8b7b6f8a534985b2d33b85fde3076b/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:05.747990 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82406-b3d8-4f19-8206-89af3c1fc2cd None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.751868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82406-b3d8-4f19-8206-89af3c1fc2cd None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.751868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82406-b3d8-4f19-8206-89af3c1fc2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.759228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d8907c198c4cec903d4d6f0a6a32e7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:05.766374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d8907c198c4cec903d4d6f0a6a32e7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:05.767061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d8907c198c4cec903d4d6f0a6a32e7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:05.776808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-20d82406-b3d8-4f19-8206-89af3c1fc2cd None None] MFA Rules not processed for user `ef8b7b6f8a534985b2d33b85fde3076b`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:05.778038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-20d82406-b3d8-4f19-8206-89af3c1fc2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.779380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d8907c198c4cec903d4d6f0a6a32e7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:05.780082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d8907c198c4cec903d4d6f0a6a32e7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:05.820960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:05.848096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1206/2424] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:05.876995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1219/2425] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:05 2022] DELETE /identity/v3/users/f5d8907c198c4cec903d4d6f0a6a32e7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:05.884798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.885277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:05.885686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.886173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:05.886805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.922223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:05.924008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:05.963127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb688c-86a9-4cb3-9d35-89a6195f717c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:05.975393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:05.977563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:05.980246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:05.980721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.014324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1207/2426] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:06.026104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:06.029657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:06.050697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:06.053735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:06.067832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1220/2427] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:06.084375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:06.085788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:06.101041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285633-786e-4e74-8c1b-ca8c43b5ee42 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:06.106970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:06.107885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:06.108170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:06.108449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] PATH_INFO: `/v3/users/ef8b7b6f8a534985b2d33b85fde3076b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.110024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8b7b6f8a534985b2d33b85fde3076b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:06.113018 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:06.120872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4d1b5-c980-457b-863a-9c46207b1d4d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:06.126401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:06.127872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:06.128579 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:06.129011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.142739 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:06.144229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309d72-9361-40e3-8a3f-68793cabe71e service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:06.155556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1208/2428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:06.377229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:06.394252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8b7b6f8a534985b2d33b85fde3076b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:06.403101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8b7b6f8a534985b2d33b85fde3076b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:06.404453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8b7b6f8a534985b2d33b85fde3076b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:06.440272 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8b7b6f8a534985b2d33b85fde3076b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:06.441373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8b7b6f8a534985b2d33b85fde3076b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:06.523300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1221/2429] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:06 2022] DELETE /identity/v3/users/ef8b7b6f8a534985b2d33b85fde3076b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:06.528462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:06.528759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:06.529047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.548307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:06.554748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:06.642223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1209/2430] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:06.656165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:06.658106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:06.720321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06787d76-2e69-46dd-8301-0b0bd1588f17 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:06.724371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:06.725179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:06.725528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:06.728904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.743078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:06.744667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:06.755506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1222/2431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:06.778460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:06.780092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:06.793031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a1af1-c394-4072-afe1-e7023e59b95c None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:06.797866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:06.798750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:06.799031 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:06.799303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] PATH_INFO: `/v3/projects/8eb6636584724ee18d6c039a6616928c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:06.800699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb6636584724ee18d6c039a6616928c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:06.803519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:06.832991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:06.981318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb6636584724ee18d6c039a6616928c', 'request_id': 'req-6c91264c-042f-471d-9863-cf44d644d5ba'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.083026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb6636584724ee18d6c039a6616928c', 'request_id': 'req-6c91264c-042f-471d-9863-cf44d644d5ba'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.095999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb6636584724ee18d6c039a6616928c', 'request_id': 'req-6c91264c-042f-471d-9863-cf44d644d5ba'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.131051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] The token cache is being invalidate because project 8eb6636584724ee18d6c039a6616928c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:07.133491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.133491 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.138684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:07.143693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1210/2432] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:06 2022] DELETE /identity/v3/projects/8eb6636584724ee18d6c039a6616928c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:07.151572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cc31-b0ea-4c09-bcd3-2b0197982afe service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:07.224388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:07.225441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.225793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.226166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] PATH_INFO: `/v3/users/2829af844b6340208e3701868c57ce7a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.227556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2829af844b6340208e3701868c57ce7a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:07.229667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:07.398027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:07.405449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:07.415277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91264c-042f-471d-9863-cf44d644d5ba admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:07.420337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:07.421549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.421829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.422100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] PATH_INFO: `/v3/projects/d166928b415c4077ba4bdc4315ea95dc` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.423390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d166928b415c4077ba4bdc4315ea95dc)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:07.425539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:07.451700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2829af844b6340208e3701868c57ce7a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.461100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:07.464438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2829af844b6340208e3701868c57ce7a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.465198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2829af844b6340208e3701868c57ce7a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.479709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2829af844b6340208e3701868c57ce7a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.480445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3763e0b2-d598-4d0c-a3ad-0094831307ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2829af844b6340208e3701868c57ce7a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.528455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd166928b415c4077ba4bdc4315ea95dc', 'request_id': 'req-9fec3472-9294-4a31-8ba3-4a1116dc3eea'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.533794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1223/2433] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:07 2022] DELETE /identity/v3/users/2829af844b6340208e3701868c57ce7a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:07.584853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd166928b415c4077ba4bdc4315ea95dc', 'request_id': 'req-9fec3472-9294-4a31-8ba3-4a1116dc3eea'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.592705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd166928b415c4077ba4bdc4315ea95dc', 'request_id': 'req-9fec3472-9294-4a31-8ba3-4a1116dc3eea'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.605926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] The token cache is being invalidate because project d166928b415c4077ba4bdc4315ea95dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:07.606239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.607089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9fec3472-9294-4a31-8ba3-4a1116dc3eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:07.609151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1211/2434] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:07 2022] DELETE /identity/v3/projects/d166928b415c4077ba4bdc4315ea95dc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:07.613869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.614280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.614739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.636216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:07.638082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:07.714622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1224/2435] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:07.722320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.722661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.722994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.745935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:07.747169 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:07.759458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1212/2436] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:07.760829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:07.773316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3bc2-73ea-4825-b5ec-4bbe4d9a3119 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:07.779492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:07.779492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.779492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.780028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.780802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:07.781113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:07.782764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:07.798076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1225/2437] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:01:07.803011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:07.815251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708146f6-2e0f-4c2b-a7a7-360ee7bdd404 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:07.835535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:07.836796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:07.837084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:07.837363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:07.838087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:07.840038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:07.940576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1213/2438] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:07 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:07.945502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:07.956411 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035b75-9133-43d6-b5c9-4d92e5b04887 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.023930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.024615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.024903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.025182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.025911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.027929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.058790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.060765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:08.075241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784a603-2819-4a57-a94c-2fb585123718 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.080667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.081662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.082019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.082404 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] PATH_INFO: `/v3/projects/63deca0b36d24d398fd8df08211b3eff` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.083828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63deca0b36d24d398fd8df08211b3eff)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.085907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.139135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1226/2439] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:07 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:08.143194 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.154312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bd444-d665-42c6-b017-17c3d7c2c492 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.159085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.159738 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.160052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.160322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.161100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.162941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.174091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1227/2440] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:08.178599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.188847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4497611-3683-45e7-9034-ce3acd861674 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.194372 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.195016 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.195296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.195566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.196394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.198010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.209106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1228/2441] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:08.213251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.223112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a501e-f039-4c51-b582-c6b1f4782f8f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.223377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63deca0b36d24d398fd8df08211b3eff', 'request_id': 'req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:08.244696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:08.283628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.284616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.284898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.285171 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] PATH_INFO: `/v3/projects/68ceb4b602bf47ab915b90758c27e539/users/1d4aeb64c7724fdc9635d5268b4f8f3c/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.290019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63deca0b36d24d398fd8df08211b3eff', 'request_id': 'req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:08.291417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:08.299904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ceb4b602bf47ab915b90758c27e539, user_id=1d4aeb64c7724fdc9635d5268b4f8f3c, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.302691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63deca0b36d24d398fd8df08211b3eff', 'request_id': 'req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:08.303770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36b8d-90d6-487b-b3ac-e0cde1c433cb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.312639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] The token cache is being invalidate because project 63deca0b36d24d398fd8df08211b3eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:08.312932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:08.313609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ce3ad3eb-cf3e-4ee3-b88c-82708028b631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:08.315184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1214/2442] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:08 2022] DELETE /identity/v3/projects/63deca0b36d24d398fd8df08211b3eff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:08.321535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9c2aa-cbb6-48cb-a6e4-7596668f4653 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.321823 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9c2aa-cbb6-48cb-a6e4-7596668f4653 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.322103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9c2aa-cbb6-48cb-a6e4-7596668f4653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.339736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-93b9c2aa-cbb6-48cb-a6e4-7596668f4653 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:08.340986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-93b9c2aa-cbb6-48cb-a6e4-7596668f4653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:08.349694 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1215/2443] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:08.357429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.357718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.357996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.376727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:08.377928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:08.386099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1216/2444] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:08.387947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1229/2445] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:08 2022] PUT /identity/v3/projects/68ceb4b602bf47ab915b90758c27e539/users/1d4aeb64c7724fdc9635d5268b4f8f3c/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:08.390475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.399578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.399763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44132761-0e8a-4808-b1dc-76b68e898579 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.399940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.400195 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.428116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] MFA Rules not processed for user `1d4aeb64c7724fdc9635d5268b4f8f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:08.429268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:08.461586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.462246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.462525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.462800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.463526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:08.463852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.465443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.477361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1217/2446] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:08.481838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.491998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3248-332c-449f-a840-61ed114d9a12 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.496613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.497253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.497537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.497740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1230/2447] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:08.497846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.498555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.500516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.509385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.511041 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:08.569651 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8c61-9f9f-49ee-8a35-21d1e5478fa6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.573398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.574071 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.574354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.574629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.584918 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.586367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.595622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1231/2448] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:01:08.601051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1218/2449] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:08.604804 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.616629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2b75-1c2e-445d-baeb-8fc64bd23049 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.660649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:08.680968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.681609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.681859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.682138 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.682838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.685142 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.801645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1232/2450] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:08 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:08.805781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.816786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbcee-e2ef-48c6-a849-1339fa66d714 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.821885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.822577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.823787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.823787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.824029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.825528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.837052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1219/2451] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:08.841299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.853188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c38416-b116-4bd2-8480-ed22fa6cf38a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.858083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.858745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.859026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.859303 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.860085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.861696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c9bb-5379-4b00-9aa8-eb21efdf442f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.873412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1233/2452] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:08.877790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:08.893488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99b02-8bc4-4246-953e-26cd3ba24661 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:08.900719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:08.901620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:08.901902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:08.902181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] PATH_INFO: `/v3/projects/36e23369933945b29307b711b99a61dc/users/7f910da6c9c7476e99347c23beb4a094/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:08.918071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e23369933945b29307b711b99a61dc, user_id=7f910da6c9c7476e99347c23beb4a094, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:08.920816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:08.992108 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1220/2453] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:08 2022] PUT /identity/v3/projects/36e23369933945b29307b711b99a61dc/users/7f910da6c9c7476e99347c23beb4a094/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:09.003197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.003643 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.004034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.033837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] MFA Rules not processed for user `7f910da6c9c7476e99347c23beb4a094`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:09.035121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:09.106817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1234/2454] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:09.111675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.185883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3adb-46a1-475f-b2c5-cf7da0b54592 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.190658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.191314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.191602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.191907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.193138 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.195177 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.210337 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:09.300402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1221/2455] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:09 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:09.301146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.313596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85fc2-69fb-422e-93b4-47188a81bcad None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.379552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.381014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.381422 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.381702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.382414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.384555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.470755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1235/2456] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:09 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:09.472099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.482810 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56041c3-9c35-42e1-9d7d-8893cf5d0224 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.488482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.489744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.490289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.490570 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.491320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.493949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.507111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1222/2457] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:09.511420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.521827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39872d1-d3ae-4d49-bf4f-fecfe16477fc admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.526459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.527345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.527622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.527959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] PATH_INFO: `/v3/projects/420dea8eebb6493cb6e17285f0deaa85/users/61969cf1c9fa4de9969dfdf2765144dc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.543235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420dea8eebb6493cb6e17285f0deaa85, user_id=61969cf1c9fa4de9969dfdf2765144dc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.545948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.641219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1236/2458] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:09 2022] PUT /identity/v3/projects/420dea8eebb6493cb6e17285f0deaa85/users/61969cf1c9fa4de9969dfdf2765144dc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:09.645418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.655721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ef8c-7466-4aeb-a2dd-74f3179a5d2a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.713234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.713930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.714237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.714513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.715353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.716969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a0055-011b-4a9f-904e-7b56bc8d88e2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.727628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1223/2459] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:09.731791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.750925 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d633-b3b9-4565-b390-fb24b7822df9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.751645 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.752727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.753006 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.753284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] PATH_INFO: `/v3/projects/420dea8eebb6493cb6e17285f0deaa85/users/61969cf1c9fa4de9969dfdf2765144dc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.756271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420dea8eebb6493cb6e17285f0deaa85, user_id=61969cf1c9fa4de9969dfdf2765144dc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:09.759031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:09.766471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:09.772550 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1237/2460] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:09 2022] PUT /identity/v3/projects/420dea8eebb6493cb6e17285f0deaa85/users/61969cf1c9fa4de9969dfdf2765144dc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:09.783116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.783409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.783689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:09.813545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] MFA Rules not processed for user `61969cf1c9fa4de9969dfdf2765144dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:09.814782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:09.892517 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1224/2461] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:09.903074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:09.905009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:09.964388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8ccf-c715-47e7-9923-4e320b27e683 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:09.968505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:09.969178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:09.969454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:09.969725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:10.027745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:10.029139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:10.039156 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1238/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:13.490403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:13.500033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9feab-f9ae-4b3d-8756-2a5350f0ac10 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:13.503944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:13.504584 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:13.504926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:13.505203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:13.514326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:13.515750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:13.526129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1225/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:14.105168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:14.106685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:14.190039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac8e4f-64f4-4354-a679-a737ffa907a8 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:14.194475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:14.195123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:14.195400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:14.195679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:14.197567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:14.297552 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:14.298989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:14.311349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1239/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:16.734356 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:16.753470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271df15-53e2-4417-ab51-91c55c82fbc3 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:16.757997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:16.758646 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:16.758928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:16.760816 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:16.762691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:16.845376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:16.857800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:16.859504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:16.873441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1226/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:18.960050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:18.962623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:18.976947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:18.981241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095255a-0ddc-436c-833d-8a1f3b12c082 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:18.986267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:18.987223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:18.987513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:18.987790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] PATH_INFO: `/v3/users/94374d8e4dfc4cd5aa0f55bedaf590c7` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:18.989308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94374d8e4dfc4cd5aa0f55bedaf590c7)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:18.991300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:19.314417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94374d8e4dfc4cd5aa0f55bedaf590c7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.323579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94374d8e4dfc4cd5aa0f55bedaf590c7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.324665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94374d8e4dfc4cd5aa0f55bedaf590c7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.338062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94374d8e4dfc4cd5aa0f55bedaf590c7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.339280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-ffb2c22f-9b25-46d7-a9cf-278a44d75e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94374d8e4dfc4cd5aa0f55bedaf590c7'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.430729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1240/2466] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:18 2022] DELETE /identity/v3/users/94374d8e4dfc4cd5aa0f55bedaf590c7 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:19.671317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:19.684130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e4285-4518-4deb-b824-4000ab91f077 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:19.749898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:19.750775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:19.751055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:19.751330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] PATH_INFO: `/v3/projects/ec8ec1602ee247fd84cb194882361179` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:19.752593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8ec1602ee247fd84cb194882361179)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:19.754487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:19.901993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8ec1602ee247fd84cb194882361179', 'request_id': 'req-1973d089-43c6-4e40-918b-7182e360dd7d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.972828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8ec1602ee247fd84cb194882361179', 'request_id': 'req-1973d089-43c6-4e40-918b-7182e360dd7d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.981509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8ec1602ee247fd84cb194882361179', 'request_id': 'req-1973d089-43c6-4e40-918b-7182e360dd7d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.993717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] The token cache is being invalidate because project ec8ec1602ee247fd84cb194882361179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:19.994011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.994670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1973d089-43c6-4e40-918b-7182e360dd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:19.996264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1227/2467] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:19 2022] DELETE /identity/v3/projects/ec8ec1602ee247fd84cb194882361179 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:20.001406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.001898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.002013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.021179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:20.022423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:20.091112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1241/2468] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:20.103011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.103011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.103011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.125019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:20.126600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:20.136451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1228/2469] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:20.140740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.151763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f31b5-13d2-4947-aa53-671c33cd8e47 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.156710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.157387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.157670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.157943 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.158678 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:20.158989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.160682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.176672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1242/2470] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:20.177885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.187550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951f3f-a6d8-49d1-86f1-adac1f729e4d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.192776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.193550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.193842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.194122 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.194854 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.196853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.299874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1229/2471] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:20 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:20.304287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.315318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06c8ea-7e85-463b-92f2-7ecdd1f71649 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.375770 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.376472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.376759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.377035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.377784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.380346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.389636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:20.491148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1243/2472] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:20 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:20.495558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.506745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286cad-6904-4330-bc04-be56fb452dfd admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.514083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.514773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.515059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.515338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.516229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.517862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.533360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1230/2473] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:20.541052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.553319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4788c6-f32a-4f80-943e-6a45a9e7486b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.560548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.561256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.561539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.561813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.562677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.564420 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88c006-8858-4671-8cdb-d862033a056e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.578040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1244/2474] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:20.582200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.594387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6511f-2077-4dc1-84ae-073ca7118f63 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.600136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.601046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.601330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.601610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] PATH_INFO: `/v3/projects/ac50e5a10d5344bdb9fcd95884580127/users/11819f7ad2ae408fbc9c0db58ee6513e/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.619034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac50e5a10d5344bdb9fcd95884580127, user_id=11819f7ad2ae408fbc9c0db58ee6513e, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.621728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.732455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1231/2475] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:20 2022] PUT /identity/v3/projects/ac50e5a10d5344bdb9fcd95884580127/users/11819f7ad2ae408fbc9c0db58ee6513e/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:20.745750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.745750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.745750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.780605 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] MFA Rules not processed for user `11819f7ad2ae408fbc9c0db58ee6513e`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:20.781834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:20.858164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1245/2476] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:20.870932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:20.873425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:20.896287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:20.953066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a59-759f-45ff-89d6-2a1a91e07598 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:20.959920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:20.960580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:20.960876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:20.961166 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:20.969684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:20.972394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:20.983239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1232/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:23.770845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:23.772935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:23.874548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef3209-b8dc-445b-a8bd-128c1655a728 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:23.879024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:23.880117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:23.880750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:23.881225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:23.883456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:23.980295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:23.982150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1d20-9d6a-4311-ae43-b23ccf86b452 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:23.996235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1246/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:27.399742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:27.418673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f4-48eb-4a92-83b5-28e350699c8d service nova] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:27.430039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:27.431229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:27.431511 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:27.432180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] PATH_INFO: `/v3/users/11819f7ad2ae408fbc9c0db58ee6513e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:27.434086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11819f7ad2ae408fbc9c0db58ee6513e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:27.441208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:27.711334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11819f7ad2ae408fbc9c0db58ee6513e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:27.714540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11819f7ad2ae408fbc9c0db58ee6513e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:27.741436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11819f7ad2ae408fbc9c0db58ee6513e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:27.821849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11819f7ad2ae408fbc9c0db58ee6513e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:27.829899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11819f7ad2ae408fbc9c0db58ee6513e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:27.836930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1233/2479] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:27 2022] DELETE /identity/v3/users/11819f7ad2ae408fbc9c0db58ee6513e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:27.841513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:27.842064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:27.842176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:27.866516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:27.866516 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:27.880765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:27.945131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1247/2480] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:27.966274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:27.968708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:28.083638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a776-66b1-4244-b728-cf88aaeb3313 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:28.091216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:28.092894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:28.093678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:28.094374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:28.125625 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:28.127264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3da3e6-f689-416b-ad18-637f342dce83 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:28.140668 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1234/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:28.704652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:28.705324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:28.726324 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53550f6-c0dd-49fb-9229-36dcc5031707 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:28.731369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:28.732586 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:28.733069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:28.733349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] PATH_INFO: `/v3/projects/ac50e5a10d5344bdb9fcd95884580127` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:28.734666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac50e5a10d5344bdb9fcd95884580127)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:28.736742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:28.903623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac50e5a10d5344bdb9fcd95884580127', 'request_id': 'req-4be58838-be4e-4389-9143-1e619d15b427'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:28.998900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac50e5a10d5344bdb9fcd95884580127', 'request_id': 'req-4be58838-be4e-4389-9143-1e619d15b427'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.006876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac50e5a10d5344bdb9fcd95884580127', 'request_id': 'req-4be58838-be4e-4389-9143-1e619d15b427'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.019666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] The token cache is being invalidate because project ac50e5a10d5344bdb9fcd95884580127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:29.026243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.026243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4be58838-be4e-4389-9143-1e619d15b427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.026243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1248/2482] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:28 2022] DELETE /identity/v3/projects/ac50e5a10d5344bdb9fcd95884580127 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:29.028909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.029764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.029764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.051063 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:29.052677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:29.063589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:29.115850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1235/2483] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:29.132309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.132959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.136191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.158832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:29.160092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:29.169039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1249/2484] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:29.173401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.184281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5193b0d-d96a-40d1-91fa-1cc7ea894e5f None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.189307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.190053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.190407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.190754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.191635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:29.192083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.193763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.206889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1236/2485] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:29.211914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.221223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817e8e-6cb0-44f7-ae3f-f989f3859338 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.226597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.227255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.227541 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.227831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.228543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.230459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.327716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1250/2486] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:29.332289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.356363 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f60c5-3fbd-4512-bf1c-1b79956924f9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.432895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.433838 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.434148 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.434763 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.435473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.437437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.579251 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1237/2487] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:29.583229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.593914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6c58-ff18-4170-9613-36a8c3f4e38e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.595327 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.597295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:29.600615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.604511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.604511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.604511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.604511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.604899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.612164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd2a00-3f3f-4ef3-a4bc-808277f9d5b2 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.618164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.619442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.619992 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.620166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1251/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:29.620619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] PATH_INFO: `/v3/users/7f910da6c9c7476e99347c23beb4a094` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.621983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f910da6c9c7476e99347c23beb4a094)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.624024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.624253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.635771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f53fa-313b-4571-b5a1-165cd66e3d9a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.642122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.643045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.643328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.643632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.644474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.646454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.667825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1252/2489] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:29.672841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.689853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db2b81-181c-4e92-a884-e21b40e8cbe5 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:29.693569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:29.694574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.694909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.695259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] PATH_INFO: `/v3/projects/e8a421b0ddb04d2dae7cbb5932fd1a5b/users/a413360693864761b1266a72795dd140/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.715934 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a421b0ddb04d2dae7cbb5932fd1a5b, user_id=a413360693864761b1266a72795dd140, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:29.719030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98bca-91b9-4a83-948d-84ac0a2ae1b3 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:29.804011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1253/2490] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:29 2022] PUT /identity/v3/projects/e8a421b0ddb04d2dae7cbb5932fd1a5b/users/a413360693864761b1266a72795dd140/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:29.815200 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.815495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.815782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.853655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] MFA Rules not processed for user `a413360693864761b1266a72795dd140`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:29.855144 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:29.856055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f910da6c9c7476e99347c23beb4a094'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.856966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f910da6c9c7476e99347c23beb4a094'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.871791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f910da6c9c7476e99347c23beb4a094'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.889781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:29.949031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1254/2491] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:29.961287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:29.962844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:29.966597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f910da6c9c7476e99347c23beb4a094'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.976622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-fa6685e7-6758-47b6-94a8-ef3f53a605d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f910da6c9c7476e99347c23beb4a094'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:29.984754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1238/2492] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:29 2022] DELETE /identity/v3/users/7f910da6c9c7476e99347c23beb4a094 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:29.991278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:29.991951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:29.992336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:29.999888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:30.011707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:30.013207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:30.062802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efb38d-b5a7-462f-98f4-9c1ee05f8bc7 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:30.092117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1239/2493] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:30.103213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:30.107726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:30.151713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2601ad8d254730b33d16e6ed1156cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:30.152952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:30.153994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:30.154518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:30.190599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d015dc-0f4c-4102-9df1-e336c655aab4 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:30.204514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:30.205793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:30.207525 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:30.208946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:30.221593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:30.223939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:30.237814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1240/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:30.241163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=100 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:30.255148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:30.257371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:30.273750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1255/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:01:30.768705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:30.778339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:30.793197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437145b-07fc-4ce2-82e4-1a9bd003af06 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:30.801301 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:30.802254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:30.803028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:30.803028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] PATH_INFO: `/v3/projects/36e23369933945b29307b711b99a61dc` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:30.804101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e23369933945b29307b711b99a61dc)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:30.806043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:30.947205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e23369933945b29307b711b99a61dc', 'request_id': 'req-086a1042-4dc1-417c-a53b-769e240876f7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.033212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e23369933945b29307b711b99a61dc', 'request_id': 'req-086a1042-4dc1-417c-a53b-769e240876f7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.045047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e23369933945b29307b711b99a61dc', 'request_id': 'req-086a1042-4dc1-417c-a53b-769e240876f7'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.070330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] The token cache is being invalidate because project 36e23369933945b29307b711b99a61dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:31.070840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.081930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.081930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1241/2496] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:30 2022] DELETE /identity/v3/projects/36e23369933945b29307b711b99a61dc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:31.082345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:31.091337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2ee7-dd49-4757-84b3-9e65ae8bbb17 service nova] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:31.196217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:31.200067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:31.202370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:31.202370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] PATH_INFO: `/v3/users/61969cf1c9fa4de9969dfdf2765144dc` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:31.202370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61969cf1c9fa4de9969dfdf2765144dc)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:31.204785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:31.568452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61969cf1c9fa4de9969dfdf2765144dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.575780 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61969cf1c9fa4de9969dfdf2765144dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.576700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61969cf1c9fa4de9969dfdf2765144dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.594178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61969cf1c9fa4de9969dfdf2765144dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.595094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61969cf1c9fa4de9969dfdf2765144dc'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:31.698679 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1256/2497] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:31 2022] DELETE /identity/v3/users/61969cf1c9fa4de9969dfdf2765144dc => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:32.257215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:32.263228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:32.275576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1042-4dc1-417c-a53b-769e240876f7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:32.354784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:32.390424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:32.391509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.395032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.395032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] PATH_INFO: `/v3/projects/420dea8eebb6493cb6e17285f0deaa85` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.395032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=420dea8eebb6493cb6e17285f0deaa85)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:32.396483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:32.569352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420dea8eebb6493cb6e17285f0deaa85', 'request_id': 'req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:32.663712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:32.665252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:32.673061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420dea8eebb6493cb6e17285f0deaa85', 'request_id': 'req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:32.682621 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420dea8eebb6493cb6e17285f0deaa85', 'request_id': 'req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:32.686147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d5c8-c317-4af5-a4d3-6bf989a96504 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:32.696297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] The token cache is being invalidate because project 420dea8eebb6493cb6e17285f0deaa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:32.696590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:32.697303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9c69868d-1ffc-4149-9e74-ab0b5abb3dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:32.704751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1242/2498] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:32 2022] DELETE /identity/v3/projects/420dea8eebb6493cb6e17285f0deaa85 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:32.706733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725df5-1692-41dd-bbab-1312cdbba63c None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.711349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725df5-1692-41dd-bbab-1312cdbba63c None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.711349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725df5-1692-41dd-bbab-1312cdbba63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.736799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e8725df5-1692-41dd-bbab-1312cdbba63c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:32.736799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e8725df5-1692-41dd-bbab-1312cdbba63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:32.768792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:32.769616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.769909 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.770732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] PATH_INFO: `/v3/users/d8501dbb6a564e6bb68d81f4b9cccf01` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.772239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8501dbb6a564e6bb68d81f4b9cccf01)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:32.774239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:32.791608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:32.796799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1243/2499] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:32.811567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.811896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.812180 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.831088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:32.832523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:32.841548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1244/2500] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:32.845947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:32.856162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952120e5-6fc8-4936-9161-a4c48a274a40 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:32.861027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:32.861682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.861966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.862245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.862973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:32.863278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:32.865413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:32.877504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1245/2501] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:01:32.882762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:32.892704 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b142-e0f9-4394-81d4-c6939a5117e1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:32.898151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:32.898798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:32.899170 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:32.899456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:32.900264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:32.903602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.053618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1246/2502] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:32 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:33.054610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.057374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8501dbb6a564e6bb68d81f4b9cccf01'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.064725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8501dbb6a564e6bb68d81f4b9cccf01'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.065608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8501dbb6a564e6bb68d81f4b9cccf01'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.081840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8501dbb6a564e6bb68d81f4b9cccf01'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.083240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8501dbb6a564e6bb68d81f4b9cccf01'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.134516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8625e3b-6e1f-4910-9cef-aa4f59f9bfc8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.140236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.140946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.141234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.141538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.142310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.144294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.210424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1257/2503] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:32 2022] DELETE /identity/v3/users/d8501dbb6a564e6bb68d81f4b9cccf01 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:33.264669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1247/2504] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:33 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:33.272763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.274208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.371455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c0ea-dc4a-421b-ae08-2c68d5430a60 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.378506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.379583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.383965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.383965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.383965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.383965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.398547 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1258/2505] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:33.400095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.413079 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1888fa-acd8-476d-9d48-52b49166af47 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.417913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.418608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.418888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.419183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.419930 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.421580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.433878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1248/2506] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:33.437885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.448336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c703b-affd-4b19-9f5a-2f7ca748f0dc admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.452983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.454352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.462523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.462523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] PATH_INFO: `/v3/projects/0d3b23134ba44c008398630a009c7257/users/1ffe6a49588d47a699a1fd6564286e03/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.471251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3b23134ba44c008398630a009c7257, user_id=1ffe6a49588d47a699a1fd6564286e03, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.474938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375e49c-bd46-46b7-adfc-2d497eff3266 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.489839 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.491830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.507393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd8eb-2eac-450d-8e5f-9ad0f609f428 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.512378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.513254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.513635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.513800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] PATH_INFO: `/v3/projects/778940a5f3e843889349e1abb13c2d66` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.514994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] RBAC: Authorizing `identity:delete_project(project_id=778940a5f3e843889349e1abb13c2d66)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.517004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.533940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1259/2507] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:33 2022] PUT /identity/v3/projects/0d3b23134ba44c008398630a009c7257/users/1ffe6a49588d47a699a1fd6564286e03/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:33.547268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.547588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.548000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.576486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] MFA Rules not processed for user `1ffe6a49588d47a699a1fd6564286e03`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:33.577720 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.630089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778940a5f3e843889349e1abb13c2d66', 'request_id': 'req-d458cbf8-fef0-4b64-bdb3-6bc41225546a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.647980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1260/2508] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:33.659483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.661262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.698458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:33.721821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ccb1-af80-4fce-b8de-59857d702f45 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.728669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778940a5f3e843889349e1abb13c2d66', 'request_id': 'req-d458cbf8-fef0-4b64-bdb3-6bc41225546a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.736798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778940a5f3e843889349e1abb13c2d66', 'request_id': 'req-d458cbf8-fef0-4b64-bdb3-6bc41225546a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.748955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] The token cache is being invalidate because project 778940a5f3e843889349e1abb13c2d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:33.749244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.749959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:33.751746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1249/2509] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:33 2022] DELETE /identity/v3/projects/778940a5f3e843889349e1abb13c2d66 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:33.757234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.758955 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.803245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.804070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.804351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.804623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.806531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.811729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:33.832398 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458cbf8-fef0-4b64-bdb3-6bc41225546a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.843770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.844714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.844986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.845262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] PATH_INFO: `/v3/users/41fa37e21f4c49d4bf0f986e0e061e8d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.846509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fa37e21f4c49d4bf0f986e0e061e8d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.848539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.884027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.885441 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:33.896801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1261/2510] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:01:33.897050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:33.900326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:33.913761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0da-7172-44c2-8349-8ffc3994f035 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:33.919128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:33.920038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:33.920322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:33.920595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] PATH_INFO: `/v3/users/a413360693864761b1266a72795dd140` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:33.921805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a413360693864761b1266a72795dd140)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:33.923744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:34.037082 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fa37e21f4c49d4bf0f986e0e061e8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.038036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fa37e21f4c49d4bf0f986e0e061e8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.050983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fa37e21f4c49d4bf0f986e0e061e8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.170734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fa37e21f4c49d4bf0f986e0e061e8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.181847 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c490549b-f1e2-4736-a269-2ee45f7356b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fa37e21f4c49d4bf0f986e0e061e8d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.189343 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1250/2511] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:33 2022] DELETE /identity/v3/users/41fa37e21f4c49d4bf0f986e0e061e8d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:34.191287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a413360693864761b1266a72795dd140'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.201225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a413360693864761b1266a72795dd140'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.202313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a413360693864761b1266a72795dd140'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.220648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a413360693864761b1266a72795dd140'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.221740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a413360693864761b1266a72795dd140'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.294310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1262/2512] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:33 2022] DELETE /identity/v3/users/a413360693864761b1266a72795dd140 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:34.299046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:34.299852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:34.300136 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:34.304114 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:34.320972 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:34.322195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:34.389261 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1251/2513] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:34.400208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:34.401560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:34.464068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c859ae-f57c-4d57-8668-771e65b3d97b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:34.465300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:34.466446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:34.466925 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:34.467246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:34.467600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:34.467980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:34.478892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:34.481368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301b17-0f73-46d9-b2e6-9dda26c381ef None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:34.485879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:34.486200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:34.487199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:34.487609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:34.487850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] PATH_INFO: `/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:34.492113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:34.492568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bad575bed754ca0bcf8b9c115e16e8e)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:34.492568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:34.503227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1263/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:34.664218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bad575bed754ca0bcf8b9c115e16e8e', 'request_id': 'req-e362cfde-f41d-47df-9b7b-5e59deeb51bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.742249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bad575bed754ca0bcf8b9c115e16e8e', 'request_id': 'req-e362cfde-f41d-47df-9b7b-5e59deeb51bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.751332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bad575bed754ca0bcf8b9c115e16e8e', 'request_id': 'req-e362cfde-f41d-47df-9b7b-5e59deeb51bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.766614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] The token cache is being invalidate because project 7bad575bed754ca0bcf8b9c115e16e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:34.766996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.768035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e362cfde-f41d-47df-9b7b-5e59deeb51bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:34.773186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1252/2515] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:34 2022] DELETE /identity/v3/projects/7bad575bed754ca0bcf8b9c115e16e8e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:35.091666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.094267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:35.110608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3773f-ef26-49cf-b2c9-8b20426f0904 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.192181 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.193176 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.193459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.193732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] PATH_INFO: `/v3/projects/e8a421b0ddb04d2dae7cbb5932fd1a5b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.195062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a421b0ddb04d2dae7cbb5932fd1a5b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.197237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.324580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a421b0ddb04d2dae7cbb5932fd1a5b', 'request_id': 'req-3b8480d6-a2ea-4985-a79f-ac3b8015f194'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:35.385170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a421b0ddb04d2dae7cbb5932fd1a5b', 'request_id': 'req-3b8480d6-a2ea-4985-a79f-ac3b8015f194'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:35.399650 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a421b0ddb04d2dae7cbb5932fd1a5b', 'request_id': 'req-3b8480d6-a2ea-4985-a79f-ac3b8015f194'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:35.412067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] The token cache is being invalidate because project e8a421b0ddb04d2dae7cbb5932fd1a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:35.412494 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:35.413062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3b8480d6-a2ea-4985-a79f-ac3b8015f194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:35.415193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1264/2516] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:35 2022] DELETE /identity/v3/projects/e8a421b0ddb04d2dae7cbb5932fd1a5b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:35.420523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.421047 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.421469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.448051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:35.449403 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:35.472123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:35.516645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1253/2517] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:35.525903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.526196 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.527624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.551910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:35.553150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:35.561674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1265/2518] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:35.566212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.577512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e4293-ca1a-4145-800a-01c7b848e890 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.582246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.584080 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.584276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.584558 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.585306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:35.585613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.587244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.604368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1254/2519] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:35.605876 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.612153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:35.616631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0724-0627-4c85-a2b5-124bb812b22c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.621882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.624217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.624217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.624217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.624217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.625930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.744428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1266/2520] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:35 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:35.747876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.760103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c90d7-15c4-4868-819c-995abecfc838 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.825140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.825862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.826137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.826410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.827110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.829062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.903162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1255/2521] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:35 2022] POST /identity/v3/users => generated 278 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:35.907416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.919583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafabc-9138-4c35-bb1f-f2dbe7ae54ef admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.929301 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.933960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.933960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.933960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.933960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.933960 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.947887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1267/2522] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:35.952096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.962683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca36b6c-6151-488a-af74-a2cf93d51dd3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:35.967714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:35.968454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:35.968727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:35.969038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:35.969824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:35.971479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e998a-5d9c-46f8-9512-260bfeab04d6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:35.984661 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1256/2523] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:35.987037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:35.998405 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f9fd-8e6d-4205-9b0c-d667fcb2ea41 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.004338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.006737 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.007241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.007744 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] PATH_INFO: `/v3/projects/5b3b0a734b8941458a85fff6ce1c2276/users/954c5a30b07c414d859dfa5c673f9c69/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.024883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3b0a734b8941458a85fff6ce1c2276, user_id=954c5a30b07c414d859dfa5c673f9c69, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.027673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.168190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1268/2524] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:35 2022] PUT /identity/v3/projects/5b3b0a734b8941458a85fff6ce1c2276/users/954c5a30b07c414d859dfa5c673f9c69/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:36.180820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.181111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.181386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.210351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] MFA Rules not processed for user `954c5a30b07c414d859dfa5c673f9c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:36.211471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:36.294650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1257/2525] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:36.299099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.365210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaf0c-c250-45a7-a84c-ddff2631864c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.370353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.371012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.371297 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.371570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.372300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.374293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.512327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1269/2526] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:36 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:36.516160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.527298 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232c1f3-0232-471a-997f-a572f4948ff5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.550594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:36.593679 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.594361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.594649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.594960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.595677 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.597666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.700315 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1258/2527] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:36 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:36.701713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.717449 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d3704-083c-4194-a291-f904d4800ef9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.718015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.718705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.719008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.719280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.720039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.721676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.734114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1270/2528] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:36.738484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.749373 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dceb20-0754-43e5-bfe8-a2468397d8e0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.754190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.755848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.756140 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.756422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] PATH_INFO: `/v3/projects/423d9dca3cb849758afcea40bccddffa/users/1526b9bb63db4376b21addc41fa79ecf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.771944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423d9dca3cb849758afcea40bccddffa, user_id=1526b9bb63db4376b21addc41fa79ecf, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.774528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.856581 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1259/2529] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:36 2022] PUT /identity/v3/projects/423d9dca3cb849758afcea40bccddffa/users/1526b9bb63db4376b21addc41fa79ecf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:36.862774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.874666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc7e0-befa-42a7-8aa0-4d13d861f7b0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.938803 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.939477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.939757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.940062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.940783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.943521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020266f-5e53-4828-8a30-d075257c8b7f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.953311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1271/2530] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:36.957610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:36.968277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181684-e03d-47f2-bf75-55e341239ff9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:36.972996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:36.974791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:36.975057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:36.977939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] PATH_INFO: `/v3/projects/423d9dca3cb849758afcea40bccddffa/users/1526b9bb63db4376b21addc41fa79ecf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:36.977939 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] RBAC: Authorizing `identity:create_grant(project_id=423d9dca3cb849758afcea40bccddffa, user_id=1526b9bb63db4376b21addc41fa79ecf, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:36.980506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:36.992936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1260/2531] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:36 2022] PUT /identity/v3/projects/423d9dca3cb849758afcea40bccddffa/users/1526b9bb63db4376b21addc41fa79ecf/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:37.003162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:37.003538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:37.005567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:37.040162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] MFA Rules not processed for user `1526b9bb63db4376b21addc41fa79ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:37.040162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:37.040162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:37.104725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1272/2532] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:37.117181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:37.118974 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:37.186520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b49e-d232-4683-be52-b2198106307a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:37.190560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:37.191214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:37.191501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:37.191782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:37.201274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:37.202727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:37.213185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1261/2533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:37.446965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:37.448705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:37.462227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ca36-b0fa-40bd-85ca-841e2804d2eb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:37.466201 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:37.466844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:37.467125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:37.467402 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:37.525916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:37.527376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878acbc-7940-4529-a292-08d597396950 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:37.536628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1273/2534] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:38.199997 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:38.201430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:38.269053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf7c7c-bbaf-4e6b-8e3f-ec831c538d35 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:38.274234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:38.275097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:38.275377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:38.275647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] PATH_INFO: `/v3/users/1ffe6a49588d47a699a1fd6564286e03` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:38.276934 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffe6a49588d47a699a1fd6564286e03)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:38.278841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:38.297657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:38.481067 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffe6a49588d47a699a1fd6564286e03'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:38.481729 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffe6a49588d47a699a1fd6564286e03'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:38.494635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffe6a49588d47a699a1fd6564286e03'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:38.572174 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffe6a49588d47a699a1fd6564286e03'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:38.579300 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffe6a49588d47a699a1fd6564286e03'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:38.585331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1262/2535] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:38 2022] DELETE /identity/v3/users/1ffe6a49588d47a699a1fd6564286e03 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:38.589868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:38.590381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:38.590546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:38.608944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:38.610189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:38.669113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1274/2536] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:38.679473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:38.681116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:38.738357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab332b30-1a77-4ee2-8d9e-0abf6416f3e2 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:38.742778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:38.743454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:38.743735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:38.744033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:38.753110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:38.754532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21dc2-7277-461c-a2ce-a4811fcf995b service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:38.764988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1263/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:39.214880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:39.216815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:39.235726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1179-e156-4bd9-8a48-42d7a1f0be01 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:39.240784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:39.242253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.242539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.242841 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] PATH_INFO: `/v3/projects/0d3b23134ba44c008398630a009c7257` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.244168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3b23134ba44c008398630a009c7257)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:39.246135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:39.362076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:39.372152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3b23134ba44c008398630a009c7257', 'request_id': 'req-4ff8458d-1c45-4ead-8216-134dc038dc46'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:39.486751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3b23134ba44c008398630a009c7257', 'request_id': 'req-4ff8458d-1c45-4ead-8216-134dc038dc46'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:39.494724 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3b23134ba44c008398630a009c7257', 'request_id': 'req-4ff8458d-1c45-4ead-8216-134dc038dc46'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:39.507581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] The token cache is being invalidate because project 0d3b23134ba44c008398630a009c7257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:39.508101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:39.508752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-4ff8458d-1c45-4ead-8216-134dc038dc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:39.510345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1275/2538] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:39 2022] DELETE /identity/v3/projects/0d3b23134ba44c008398630a009c7257 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:39.515509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.516100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.516100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.534778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:39.536036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:39.602609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1264/2539] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:39.611328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.611898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.612203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.633437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:39.634856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:39.643398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1276/2540] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:39.648159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:39.657993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbdc13-dd69-415c-be4f-58afe6fff757 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:39.663106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:39.663782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.664104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.664383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.665120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:39.665428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:39.667132 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:39.680941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1265/2541] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:01:39.685802 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:39.696496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69221b93-4d57-4439-81be-74e7a2f59215 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:39.701691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:39.702500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.702792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.703349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.704122 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:39.706319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:39.798283 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1277/2542] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:39 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:39.799501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:39.811476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25cc0e-29a3-43a8-b659-04cd32cf4d00 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:39.833009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:39.870820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:39.871411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:39.871725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:39.872007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:39.872707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:39.874616 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:39.996429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1266/2543] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:39 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:40.000496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:40.011045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5aa53-2ff7-4a97-ae66-b07b612541fd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:40.015598 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:40.016311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:40.016582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:40.016858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:40.017585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:40.019197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:40.029843 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1278/2544] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:40.033862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:40.044736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044db13-df27-4515-91c8-b58e5d52bb93 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:40.049987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:40.050662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:40.051257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:40.051624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:40.052441 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:40.054965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533b90-c79b-4246-bf96-fa7935d9774e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:40.066700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1267/2545] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:40.071258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:40.081523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4041ce-8d8e-4a81-9412-268f026c1b48 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:40.086644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:40.087531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:40.087831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:40.088112 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] PATH_INFO: `/v3/projects/ddfa48ba43cf4c8eb02bd400a32bc965/users/647f63660ab5468faace58d69740609e/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:40.106009 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfa48ba43cf4c8eb02bd400a32bc965, user_id=647f63660ab5468faace58d69740609e, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:40.108771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:40.252801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1279/2546] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:40 2022] PUT /identity/v3/projects/ddfa48ba43cf4c8eb02bd400a32bc965/users/647f63660ab5468faace58d69740609e/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:40.269153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:40.269443 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:40.269741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:40.298035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] MFA Rules not processed for user `647f63660ab5468faace58d69740609e`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:40.299262 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:40.365175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1268/2547] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:40.376807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:40.378499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:40.437012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955e43-15cb-449d-9eff-fba61f2dd987 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:40.440763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:40.441407 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:40.441684 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:40.441959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:40.451597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:40.453542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:40.463148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1280/2548] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:46.809950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:46.811485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:46.871288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac65c-010d-4977-9b6e-086fee809941 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:46.874804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:46.875458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:46.875782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:46.876086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:46.881331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:46.927908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:46.947059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:46.948641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719c0b3-9fd2-4551-a096-2137350e360d service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:46.958748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1269/2549] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:47.439207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:47.441862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:47.474110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624419-b7f8-4c0a-8cc4-b5598df1fbb8 service glance] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:47.482045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:47.483011 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:47.483391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:47.483750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] PATH_INFO: `/v3/users/1d4aeb64c7724fdc9635d5268b4f8f3c` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:47.485162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4aeb64c7724fdc9635d5268b4f8f3c)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:47.487795 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:47.765999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4aeb64c7724fdc9635d5268b4f8f3c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:47.773856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4aeb64c7724fdc9635d5268b4f8f3c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:47.774564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4aeb64c7724fdc9635d5268b4f8f3c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:47.776515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:47.788686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4aeb64c7724fdc9635d5268b4f8f3c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:47.789519 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4aeb64c7724fdc9635d5268b4f8f3c'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:47.881385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1281/2550] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:47 2022] DELETE /identity/v3/users/1d4aeb64c7724fdc9635d5268b4f8f3c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:47.886762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:47.887619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:47.887941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:47.906967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:47.908264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:47.980219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1270/2551] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:47.996260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:47.997797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:48.065952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349fd4-3501-45a8-bf21-4b1c39dc96ec admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:48.071068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:48.071745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:48.072080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:48.072395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:48.084300 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:48.089627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df27a-6e6b-490a-a7db-55a261c32ebc service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:48.100008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1282/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:48.763222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:48.770125 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:48.782069 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560b8b-c99c-493f-9857-28a0b9a17414 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:48.787296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:48.788281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:48.789276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:48.789378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] PATH_INFO: `/v3/projects/68ceb4b602bf47ab915b90758c27e539` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:48.790749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ceb4b602bf47ab915b90758c27e539)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:48.792859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:48.932449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ceb4b602bf47ab915b90758c27e539', 'request_id': 'req-af6dfd75-0661-4596-84bb-2c32858f78bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:49.069782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ceb4b602bf47ab915b90758c27e539', 'request_id': 'req-af6dfd75-0661-4596-84bb-2c32858f78bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:49.086338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ceb4b602bf47ab915b90758c27e539', 'request_id': 'req-af6dfd75-0661-4596-84bb-2c32858f78bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:49.090482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] The token cache is being invalidate because project 68ceb4b602bf47ab915b90758c27e539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:49.090759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:49.091430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-af6dfd75-0661-4596-84bb-2c32858f78bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:49.095852 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1271/2553] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:48 2022] DELETE /identity/v3/projects/68ceb4b602bf47ab915b90758c27e539 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:49.098535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.099052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.099356 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.127538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:49.129571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:49.216717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1283/2554] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:49.224848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.225142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.225426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.245848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:49.247510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:49.256826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1272/2555] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:49.261374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.272148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c72de-80bc-4f61-b0b8-085fad843806 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.277896 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.278691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.279050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.279394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.280247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:49.280648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.282286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.302230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1284/2556] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:49.306482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.320817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b0eb1-508d-4f3d-a6d4-92e16d4e95a7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.326851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.327689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.330808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.330808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.330808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.331270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.464701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1273/2557] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:49 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:49.469380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.486267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8e17-8676-4b52-96fa-73de1ba63e5a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.570442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.571131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.571533 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.572225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.572958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.575311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.588460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:49.660021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1285/2558] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:49 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:49.661258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.678908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed74e-a260-4e1c-ac09-11672c990ac2 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.689117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.689117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.689117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.689117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.689782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.692963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.707289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1274/2559] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:49.711970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.729637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921aea9-4bc7-4ac7-8b1e-b8260945d477 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.735321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.736054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.736331 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.736613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.737359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.739038 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51088d-f3ce-40c2-89d4-53d15cbae5ad admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.751130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1286/2560] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:49.755390 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:49.766556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7266-bd21-4345-8638-1ebf739609c8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:49.771485 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:49.772409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.772693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.780877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] PATH_INFO: `/v3/projects/e7945e317ab24ea39ac42ebeb2f26aee/users/b7a0e36a3e474f48b8b205aa87da0d87/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.794835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7945e317ab24ea39ac42ebeb2f26aee, user_id=b7a0e36a3e474f48b8b205aa87da0d87, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:49.797561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:49.921667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1275/2561] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:49 2022] PUT /identity/v3/projects/e7945e317ab24ea39ac42ebeb2f26aee/users/b7a0e36a3e474f48b8b205aa87da0d87/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:49.932965 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:49.933597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:49.933789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:49.975854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] MFA Rules not processed for user `b7a0e36a3e474f48b8b205aa87da0d87`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:49.975854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:50.080453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1287/2562] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:50.090837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:50.092757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:50.099637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:50.182830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420decb6-784c-4e35-ab7e-c85b57c4e6dd admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:50.190953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:50.191819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:50.192158 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:50.192455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:50.209055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:50.211227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:50.221424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1276/2563] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:51.603590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:51.605104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:51.676857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067de5-e9f3-4429-83d6-0378e39b5f86 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:51.682344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:51.683696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:51.684033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:51.684285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] PATH_INFO: `/v3/users/fd48e2130723461d8d09484cb3b7a0df` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:51.685517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd48e2130723461d8d09484cb3b7a0df)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:51.687484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:51.936971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd48e2130723461d8d09484cb3b7a0df'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:51.944762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd48e2130723461d8d09484cb3b7a0df'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:51.945576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd48e2130723461d8d09484cb3b7a0df'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:51.958717 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd48e2130723461d8d09484cb3b7a0df'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:51.960131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-224e63b2-4056-4a14-96be-734abaddc7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd48e2130723461d8d09484cb3b7a0df'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:51.963296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:52.040229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1288/2564] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:51 2022] DELETE /identity/v3/users/fd48e2130723461d8d09484cb3b7a0df => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:52.322405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:52.337088 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b3cb-53f1-4570-be45-a5f6386c43eb service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:52.408631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:52.409504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:52.409783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:52.410058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] PATH_INFO: `/v3/projects/a5bf248f413c43d49f7ff03dce6febad` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:52.411357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5bf248f413c43d49f7ff03dce6febad)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:52.414205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:52.514902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5bf248f413c43d49f7ff03dce6febad', 'request_id': 'req-64f5073c-a2c8-4ca7-8736-c2b686261938'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:52.578950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5bf248f413c43d49f7ff03dce6febad', 'request_id': 'req-64f5073c-a2c8-4ca7-8736-c2b686261938'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:52.587721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5bf248f413c43d49f7ff03dce6febad', 'request_id': 'req-64f5073c-a2c8-4ca7-8736-c2b686261938'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:52.604565 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] The token cache is being invalidate because project a5bf248f413c43d49f7ff03dce6febad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:52.604907 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:52.605647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-64f5073c-a2c8-4ca7-8736-c2b686261938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:52.607352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1277/2565] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:52 2022] DELETE /identity/v3/projects/a5bf248f413c43d49f7ff03dce6febad => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:52.612870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:52.613781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:52.614221 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:52.636068 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:52.637624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:52.715790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1289/2566] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:52.719172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:52.719341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:52.719637 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:52.760576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:52.762203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:52.771924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1278/2567] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:52.777139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:52.788230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068f59-a2cb-4c8d-866a-087931fa8258 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:52.793058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:52.793785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:52.794234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:52.794559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:52.795246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:52.795592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:52.797240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:52.810989 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1290/2568] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:01:52.814981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:52.827186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6284e-a81a-4ecd-b1a2-16c1df740a9a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:52.832366 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:52.833118 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:52.833406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:52.833682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:52.834393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:52.837155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:52.936750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1279/2569] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:52 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:52.941056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:52.955066 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d0ff-6596-4df3-8ef9-171ec762e2e1 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.024022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.024703 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.024984 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.025252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.026348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.028225 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.093073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1291/2570] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:52 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:53.097858 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.108648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2304059-442d-4ee7-80fa-6623811344de admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.113486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.114072 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.114351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.114624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.115670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.120508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.122620 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:53.136585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1280/2571] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:53.140938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.152353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7845b6-4e3f-4aa0-a9ba-555c4506756a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.157336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.157998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.158277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.158549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.159296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.161053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0719-0a1e-4984-a135-b536a9dffb36 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.174186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1292/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:53.178290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.192629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7964691-552f-4ff1-ae11-6c33621f6225 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.217498 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.219903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.220205 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.220712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] PATH_INFO: `/v3/projects/3843d7c5f54b4a01be1ea3069c593f60/users/9d27d11eea0540df8cc7a13f9d146903/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.238941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3843d7c5f54b4a01be1ea3069c593f60, user_id=9d27d11eea0540df8cc7a13f9d146903, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.242912 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.328090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1281/2573] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:53 2022] PUT /identity/v3/projects/3843d7c5f54b4a01be1ea3069c593f60/users/9d27d11eea0540df8cc7a13f9d146903/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:53.340558 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.340851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.341132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.371472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] MFA Rules not processed for user `9d27d11eea0540df8cc7a13f9d146903`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:53.372676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:53.423337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:53.442539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1293/2574] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:53.447154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.515141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d124f-3540-435d-a7e5-7c3a9b26b422 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.520228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.520892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.521176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.521449 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.522145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.524322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.605147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1282/2575] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:53 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:53.609480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.622337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f748d-5060-4a71-9304-3cc779eadb37 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.683546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.684260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.684551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.684830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.685543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.687497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.773564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1294/2576] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:53 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:53.777600 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.791143 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb559f4-424b-4f6f-b468-1ac14a6027fc admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.796036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.797129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.797129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.797307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.798185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.799888 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.814942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1283/2577] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:53.819097 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.829725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5468e5-314d-4b51-88ba-d3b2bd02012e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:53.834620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:53.836351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:53.836692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:53.836974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] PATH_INFO: `/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea/users/35b194e45a5f41c49ff63808187ba5d2/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:53.859318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2155728c854e5a9d61e03aec5fa4ea, user_id=35b194e45a5f41c49ff63808187ba5d2, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:53.864147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:53.959125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1295/2578] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:53 2022] PUT /identity/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea/users/35b194e45a5f41c49ff63808187ba5d2/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:53.967295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:53.980623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd371f-6a72-47a5-88b3-c325180024d1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:54.045757 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:54.046444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:54.046709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:54.046983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:54.047709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:54.049328 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43605-c5e0-4038-b2d3-b3cb57fb93b5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:54.074399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1284/2579] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:54.077014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:54.090173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954441-dbb6-40d6-9fe5-bd701556010b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:54.096660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:54.097715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:54.106629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:54.106629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] PATH_INFO: `/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea/users/35b194e45a5f41c49ff63808187ba5d2/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:54.106629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2155728c854e5a9d61e03aec5fa4ea, user_id=35b194e45a5f41c49ff63808187ba5d2, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:54.106629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:54.120259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1296/2580] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:54 2022] PUT /identity/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea/users/35b194e45a5f41c49ff63808187ba5d2/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:54.136048 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df2a6-26a0-409e-8570-95851923019e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:54.136526 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df2a6-26a0-409e-8570-95851923019e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:54.139578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df2a6-26a0-409e-8570-95851923019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:54.171640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-270df2a6-26a0-409e-8570-95851923019e None None] MFA Rules not processed for user `35b194e45a5f41c49ff63808187ba5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:54.172889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-270df2a6-26a0-409e-8570-95851923019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:54.207790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:54.258279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1285/2581] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:54.275749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:54.277940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:54.347101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e771d6-d33b-4772-8feb-262c23799eb0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:54.350893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:54.351846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:54.352133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:54.352409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:54.361580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:54.363027 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c83e1-301d-4323-a6f1-d3102dae8051 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:54.373718 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1297/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:54.599021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df2a6-26a0-409e-8570-95851923019e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:54.671865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df2a6-26a0-409e-8570-95851923019e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:54.677023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:54.677891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:54.678210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:54.678486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] PATH_INFO: `/v3/users/9d27d11eea0540df8cc7a13f9d146903` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:54.680608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d27d11eea0540df8cc7a13f9d146903)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:54.682617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:54.872255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d27d11eea0540df8cc7a13f9d146903'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:54.873014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d27d11eea0540df8cc7a13f9d146903'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:54.885663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d27d11eea0540df8cc7a13f9d146903'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:54.989645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d27d11eea0540df8cc7a13f9d146903'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:54.999697 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d27d11eea0540df8cc7a13f9d146903'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.006543 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1286/2583] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:54 2022] DELETE /identity/v3/users/9d27d11eea0540df8cc7a13f9d146903 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:55.011861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:55.012349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:55.012577 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:55.030835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:55.032078 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:55.079834 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:55.102991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1298/2584] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:55.115129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:55.116204 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:55.188659 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:55.194008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45633d-aadb-4bbf-b23e-95799e6e7f08 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:55.200963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:55.201629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:55.201966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:55.202181 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:55.212602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:55.214045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:55.223918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1287/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:01:55.732234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:55.734230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:55.748267 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cef69-61a1-4e2a-bdab-479d52f96b5f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:55.754587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:55.755521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:55.755823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:55.756114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] PATH_INFO: `/v3/projects/3843d7c5f54b4a01be1ea3069c593f60` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:55.758423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3843d7c5f54b4a01be1ea3069c593f60)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:55.761671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:55.896428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3843d7c5f54b4a01be1ea3069c593f60', 'request_id': 'req-b26eb02b-a592-495b-9526-1238ba231225'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.978287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3843d7c5f54b4a01be1ea3069c593f60', 'request_id': 'req-b26eb02b-a592-495b-9526-1238ba231225'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.985126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3843d7c5f54b4a01be1ea3069c593f60', 'request_id': 'req-b26eb02b-a592-495b-9526-1238ba231225'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.996152 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] The token cache is being invalidate because project 3843d7c5f54b4a01be1ea3069c593f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:55.996506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.997134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:55.998696 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1299/2586] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:55 2022] DELETE /identity/v3/projects/3843d7c5f54b4a01be1ea3069c593f60 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:56.003172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:56.013106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbebd8-ff97-4a22-8553-f22fb095f537 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:56.073550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:56.074476 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:56.074764 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:56.075042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] PATH_INFO: `/v3/users/35b194e45a5f41c49ff63808187ba5d2` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:56.076288 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b194e45a5f41c49ff63808187ba5d2)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:56.078219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:56.306908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b194e45a5f41c49ff63808187ba5d2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:56.307501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b194e45a5f41c49ff63808187ba5d2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:56.321144 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b194e45a5f41c49ff63808187ba5d2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:56.406601 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b194e45a5f41c49ff63808187ba5d2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:56.414946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-1bb51c8d-c8d3-4301-adf2-ed2839e78490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b194e45a5f41c49ff63808187ba5d2'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:56.421594 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1288/2587] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:56 2022] DELETE /identity/v3/users/35b194e45a5f41c49ff63808187ba5d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:56.844284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:56.849427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:56.867610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb02b-a592-495b-9526-1238ba231225 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:56.955625 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:56.956532 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:56.956998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:56.957279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] PATH_INFO: `/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:56.958581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2155728c854e5a9d61e03aec5fa4ea)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:56.961452 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.135496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2155728c854e5a9d61e03aec5fa4ea', 'request_id': 'req-87c36fd7-242b-494a-8c01-40b5d4183fbf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.249781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2155728c854e5a9d61e03aec5fa4ea', 'request_id': 'req-87c36fd7-242b-494a-8c01-40b5d4183fbf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.256725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2155728c854e5a9d61e03aec5fa4ea', 'request_id': 'req-87c36fd7-242b-494a-8c01-40b5d4183fbf'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.272053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:57.282956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] The token cache is being invalidate because project 0e2155728c854e5a9d61e03aec5fa4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:57.282956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.282956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.282956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1300/2588] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:56 2022] DELETE /identity/v3/projects/0e2155728c854e5a9d61e03aec5fa4ea => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:57.284514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b92f-96c9-41af-8bb4-4414590be875 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.285013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b92f-96c9-41af-8bb4-4414590be875 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.285111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b92f-96c9-41af-8bb4-4414590be875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.316303 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e6a4b92f-96c9-41af-8bb4-4414590be875 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:57.317564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e6a4b92f-96c9-41af-8bb4-4414590be875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.325769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.327307 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.400309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1289/2589] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:57.407837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36fd7-242b-494a-8c01-40b5d4183fbf admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.409542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.410457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.410745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.413056 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.414882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.415235 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.415639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] PATH_INFO: `/v3/users/954c5a30b07c414d859dfa5c673f9c69` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.417110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954c5a30b07c414d859dfa5c673f9c69)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.425903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.432457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:57.434076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.443446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1290/2590] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:57.447953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.452563 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:57.462203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fed96-5c1b-4f6b-ad7e-9742eef543a6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.467530 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.468282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.468568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.468836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.469599 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:01:57.470250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.471768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.484738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1291/2591] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:01:57.489127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.499849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b60ec-8909-438d-bc2d-452017584c6a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.505035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.505710 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.505993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.506269 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.507076 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.509767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.603246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1292/2592] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:57 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:57.604200 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.607567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954c5a30b07c414d859dfa5c673f9c69'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.614875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954c5a30b07c414d859dfa5c673f9c69'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.615683 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954c5a30b07c414d859dfa5c673f9c69'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.628531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954c5a30b07c414d859dfa5c673f9c69'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.629299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7f2bd67-5fef-4292-bb54-cf86c5afcce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954c5a30b07c414d859dfa5c673f9c69'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:57.671983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40227bd0-6ce0-439e-82e2-3bbaf095aa16 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.676924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.677613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.677932 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.678395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.680277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.682432 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.715820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1301/2593] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:57 2022] DELETE /identity/v3/users/954c5a30b07c414d859dfa5c673f9c69 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:57.721971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.722335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.722622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.742182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:57.743623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.805052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1293/2594] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:57 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:01:57.810528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.810690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1302/2595] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:57.810785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.820351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.821924 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:57.822172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000ae2-1d28-495b-9935-7199af6bcfeb admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.828245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.828928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.829208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.829483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.830218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.831836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.842935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1294/2596] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:57.845341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:57.846891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.857520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8e37-f778-460a-840d-128b368a1c7b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.862242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.866380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.866380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.866380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.866380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.866380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.878546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1295/2597] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:01:57.882768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:57.885670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfee0-ea2b-4123-a4ed-1b37f1a6a238 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.889413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.890074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.890353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.890629 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.893082 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdffa-b396-472a-b2df-9f1aeae81a1f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:57.897846 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:57.898996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:57.899278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:57.899550 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] PATH_INFO: `/v3/projects/97d6e829a356479482ab3eefe3508277/users/81ab20729bb04b0dbea8e1931cf0eb85/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:57.900595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.902049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2c97-bf10-42f3-9bdb-0f5bf6ede240 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:57.912110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1303/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:01:57.916084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d6e829a356479482ab3eefe3508277, user_id=81ab20729bb04b0dbea8e1931cf0eb85, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:57.918788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.006425 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1296/2599] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:57 2022] PUT /identity/v3/projects/97d6e829a356479482ab3eefe3508277/users/81ab20729bb04b0dbea8e1931cf0eb85/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:58.017080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.017393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.017635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.046141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] MFA Rules not processed for user `81ab20729bb04b0dbea8e1931cf0eb85`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:58.047363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:58.115950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1304/2600] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:01:58.121360 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.195471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e43b9-6f3e-4711-8dd4-672d90b7eb84 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.200370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.201412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.201412 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.220212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.220212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.220212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.222227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:58.451309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1297/2601] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:01:58 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:58.455086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.466277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa477ea-2dd4-455a-8712-b8310d4f5aaf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.494473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.496559 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:58.531488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.532215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.532497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.532776 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.533730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.535595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.573190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ea65-966a-4a7d-9963-b788bd3e900d admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.577851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.578720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.580284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.580284 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] PATH_INFO: `/v3/projects/5b3b0a734b8941458a85fff6ce1c2276` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.580512 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3b0a734b8941458a85fff6ce1c2276)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.582477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.664715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1305/2602] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:01:58 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:01:58.666311 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.676889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8905-3549-4141-8795-0e7d40090198 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.681617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.682376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.682660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.682937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.683986 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.685711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.699560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1306/2603] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:58.700883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.711461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f49c3-ef24-4f99-9bd1-9b86a30ba0fe admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.722390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.722390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.722390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.722390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] PATH_INFO: `/v3/projects/2c687f5085094d2fb913cabcd336f05b/users/27caf3a9a78647498c7a38874f181961/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.737259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3b0a734b8941458a85fff6ce1c2276', 'request_id': 'req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:58.743437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c687f5085094d2fb913cabcd336f05b, user_id=27caf3a9a78647498c7a38874f181961, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.747033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.832538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3b0a734b8941458a85fff6ce1c2276', 'request_id': 'req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:58.840542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3b0a734b8941458a85fff6ce1c2276', 'request_id': 'req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:58.851604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] The token cache is being invalidate because project 5b3b0a734b8941458a85fff6ce1c2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:01:58.851919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:58.852580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:58.854274 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1298/2604] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:58 2022] DELETE /identity/v3/projects/5b3b0a734b8941458a85fff6ce1c2276 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:58.858086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.859393 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:58.873915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1307/2605] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:58 2022] PUT /identity/v3/projects/2c687f5085094d2fb913cabcd336f05b/users/27caf3a9a78647498c7a38874f181961/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:01:58.879108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:58.880930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:58.890282 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:58.934509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4e04-916b-42e5-b3b3-1bb60a2acd7c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.954575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b002f8-9d3a-4246-a822-bf075b44f9e2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:58.959578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:58.960316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:58.960607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:58.960894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:58.961699 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:58.966848 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:58.971538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:58.987563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1308/2606] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:01:58.992740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:59.002590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:59.003566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:59.004090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:59.004440 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] PATH_INFO: `/v3/users/1526b9bb63db4376b21addc41fa79ecf` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:59.004848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d3d-505d-4b5d-ac0f-cdcdca67374c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:59.006167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1526b9bb63db4376b21addc41fa79ecf)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:59.010266 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:59.011459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:59.012403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:59.012956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:59.012956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] PATH_INFO: `/v3/projects/2c687f5085094d2fb913cabcd336f05b/users/27caf3a9a78647498c7a38874f181961/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:59.015204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c687f5085094d2fb913cabcd336f05b, user_id=27caf3a9a78647498c7a38874f181961, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:59.018798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c6d3-4e92-4168-9f3a-c5bb4d80cc43 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:59.033278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1309/2607] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:01:58 2022] PUT /identity/v3/projects/2c687f5085094d2fb913cabcd336f05b/users/27caf3a9a78647498c7a38874f181961/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:59.044215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:59.044518 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:59.045125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:59.075150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] MFA Rules not processed for user `27caf3a9a78647498c7a38874f181961`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:01:59.076418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:59.157654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1310/2608] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:01:59.169600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:59.171061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:59.235203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae81c-bc09-4388-8943-ae17cc6e46bb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:59.238922 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:59.239583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:59.239900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:59.240170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:59.243773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:01:59.258436 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1526b9bb63db4376b21addc41fa79ecf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:59.259163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1526b9bb63db4376b21addc41fa79ecf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:59.274188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1526b9bb63db4376b21addc41fa79ecf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:59.280327 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:59.317008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:59.318590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:01:59.328239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1311/2609] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:01:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:01:59.369878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1526b9bb63db4376b21addc41fa79ecf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:59.378458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-95bde296-f58b-4cd8-90ea-60e64d2420c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1526b9bb63db4376b21addc41fa79ecf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:01:59.384754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1299/2610] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:01:58 2022] DELETE /identity/v3/users/1526b9bb63db4376b21addc41fa79ecf => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:01:59.819115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:01:59.891793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b85ef-6fb9-424c-bfdd-427a6131d0f4 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:01:59.958946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:01:59.959858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:01:59.960775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:01:59.961034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] PATH_INFO: `/v3/projects/423d9dca3cb849758afcea40bccddffa` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:01:59.962504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=423d9dca3cb849758afcea40bccddffa)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:01:59.964526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.155513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423d9dca3cb849758afcea40bccddffa', 'request_id': 'req-b91f8fc8-4c98-4244-8efe-4043a91a63fb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:00.238656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423d9dca3cb849758afcea40bccddffa', 'request_id': 'req-b91f8fc8-4c98-4244-8efe-4043a91a63fb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:00.247116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423d9dca3cb849758afcea40bccddffa', 'request_id': 'req-b91f8fc8-4c98-4244-8efe-4043a91a63fb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:00.259827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] The token cache is being invalidate because project 423d9dca3cb849758afcea40bccddffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:00.260220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:00.261094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-b91f8fc8-4c98-4244-8efe-4043a91a63fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:00.262850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1312/2611] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:01:59 2022] DELETE /identity/v3/projects/423d9dca3cb849758afcea40bccddffa => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:00.267917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.270999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.270999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.289124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:00.290415 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:00.353814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1300/2612] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:00.362063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.362353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.362632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.370465 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:00.382847 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:00.388521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:00.392470 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1313/2613] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:00.396877 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.408084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0399f8-a0c2-4600-9981-77ef1cb57a21 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.412787 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.413482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.413971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.414419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.415152 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:00.415465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.417229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.429538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1301/2614] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:00.435473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.446100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad359ea2-2c70-4fba-a241-eba5ee41296f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.451237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.451983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.452266 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.452543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.453244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.455182 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.545202 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1314/2615] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:00 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:00.549698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.560638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998020a-efe6-4b98-b7c0-bff880246a36 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.598685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:00.617231 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.618061 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.618316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.618706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.619286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.621257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.748428 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1302/2616] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:00 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:00.752765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.763427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede127f-bd09-4742-a0a8-aabc31077b5f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.768715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.770877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.770877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.770877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.770877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.772408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.783674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1315/2617] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:00.788099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.799045 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a737a-fafa-4a67-ad79-1a48de89e63f admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.803982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.804688 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.805008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.805999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.806706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.808593 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545635a1-d470-4511-9c26-f1d38d56adda admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.819826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1303/2618] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:00.824119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:00.834483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8918-5d60-4ffc-b19a-9690a77c5669 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:00.839353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:00.840277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.840560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.840866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] PATH_INFO: `/v3/projects/6821e6fc3bc94b76b6d6c16d667b52d5/users/ea2f2acc384e44358f9b2137e8e22c83/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:00.857859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6821e6fc3bc94b76b6d6c16d667b52d5, user_id=ea2f2acc384e44358f9b2137e8e22c83, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:00.860537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:00.962053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1316/2619] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:00 2022] PUT /identity/v3/projects/6821e6fc3bc94b76b6d6c16d667b52d5/users/ea2f2acc384e44358f9b2137e8e22c83/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:00.973651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:00.973938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:00.974211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.001268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] MFA Rules not processed for user `ea2f2acc384e44358f9b2137e8e22c83`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:01.002523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:01.075222 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1304/2620] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:01.080316 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.106091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.107504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:01.160414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe8cf-6664-4e87-b29f-7d121f55dbf1 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.166362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.167033 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.167363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.167640 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.168575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.174594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.193542 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0e38-69e2-4718-bedf-6d3e1f27e7e1 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.198263 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.198998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.199294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.199574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.201493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:01.281434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.282883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.289940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1317/2621] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:01 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:01.290175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:01.291215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.294119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1305/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:01.361941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f9a3-c8f4-4430-8037-adc4a8eda57f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.366961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.368211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.368502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.368781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.369519 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.371559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.498394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1318/2623] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:01 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:01.502382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.513748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43c38-649a-479e-8143-da320015a8b1 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.518208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.518924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.519213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.519508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.520295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.521921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.532928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1306/2624] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:01.537284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.547964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ec9c-866e-46a5-a028-dde90ece695f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.552623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.553503 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.553791 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.554073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] PATH_INFO: `/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d/users/b7c21ec8df5946c193ab0963df850909/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.570562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:01.573837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9b0b14d6e44d3984f041f2aa10ac0d, user_id=b7c21ec8df5946c193ab0963df850909, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.576714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.680141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1319/2625] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:01 2022] PUT /identity/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d/users/b7c21ec8df5946c193ab0963df850909/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:01.684424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.694446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de839d7-3926-4a89-a693-309c1460e509 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.753112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.753773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.754052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.754329 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.755046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.756690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f8c49-1ab7-47e7-b079-8aaee0023a8f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.767464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1307/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:01.772013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.789779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc37a93-8197-45e9-b7b7-74a6c7049ff6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:01.789779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:01.789779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.789779 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.790187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] PATH_INFO: `/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d/users/b7c21ec8df5946c193ab0963df850909/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.791709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9b0b14d6e44d3984f041f2aa10ac0d, user_id=b7c21ec8df5946c193ab0963df850909, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:01.794500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:01.805396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1320/2627] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:01 2022] PUT /identity/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d/users/b7c21ec8df5946c193ab0963df850909/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:01.816246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:01.846960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:01.846960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:01.846960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] MFA Rules not processed for user `b7c21ec8df5946c193ab0963df850909`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:01.846960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:01.921335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1308/2628] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:01.940855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:01.998976 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34cc0-5ebe-4e10-b161-44091d3f4f10 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:02.002787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:02.003920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:02.004432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:02.004827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:02.014899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:02.016418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:02.026739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1321/2629] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:02.253884 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:02.266629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02ffa1-1e11-46be-af23-a85fe4ac8a8d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:02.270227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:02.270867 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:02.271149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:02.271424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:02.329965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:02.331459 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc85308-4425-44e9-9fb4-1a1483103e16 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:02.341873 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1309/2630] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:02.654154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:02.655592 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:02.724913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6468-e908-47f3-ae99-2ab3ad952f12 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:02.730639 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662113e-5025-462c-8c54-24981074752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:02.731536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662113e-5025-462c-8c54-24981074752d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:02.731836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662113e-5025-462c-8c54-24981074752d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:02.732121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662113e-5025-462c-8c54-24981074752d admin admin] PATH_INFO: `/v3/users/b7a0e36a3e474f48b8b205aa87da0d87` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:02.733352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662113e-5025-462c-8c54-24981074752d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a0e36a3e474f48b8b205aa87da0d87)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:02.736101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662113e-5025-462c-8c54-24981074752d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:02.964366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a0e36a3e474f48b8b205aa87da0d87'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:02.971531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a0e36a3e474f48b8b205aa87da0d87'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:02.972254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a0e36a3e474f48b8b205aa87da0d87'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:02.987348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a0e36a3e474f48b8b205aa87da0d87'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:02.988185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a0e36a3e474f48b8b205aa87da0d87'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.094374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:03.098955 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1322/2631] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:02 2022] DELETE /identity/v3/users/b7a0e36a3e474f48b8b205aa87da0d87 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:03.104253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:03.104740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:03.104915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:03.117382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:03.125673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:03.126928 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:03.192461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1310/2632] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:03.203102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:03.204710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:03.286672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662113e-5025-462c-8c54-24981074752d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:03.286672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:03.286672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:03.286672 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:03.287363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:03.297674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:03.299127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:03.310395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1323/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:03.725229 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:03.733244 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:03.743310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9313774-761f-4175-8537-43d141dce5a0 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:03.762342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:03.763457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:03.763832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:03.763832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] PATH_INFO: `/v3/projects/e7945e317ab24ea39ac42ebeb2f26aee` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:03.765595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7945e317ab24ea39ac42ebeb2f26aee)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:03.767442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:03.877178 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7945e317ab24ea39ac42ebeb2f26aee', 'request_id': 'req-3f5422b8-14bb-46a8-8e7a-f09ff634322a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.954845 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7945e317ab24ea39ac42ebeb2f26aee', 'request_id': 'req-3f5422b8-14bb-46a8-8e7a-f09ff634322a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.962578 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7945e317ab24ea39ac42ebeb2f26aee', 'request_id': 'req-3f5422b8-14bb-46a8-8e7a-f09ff634322a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.973725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] The token cache is being invalidate because project e7945e317ab24ea39ac42ebeb2f26aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:03.974016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.974680 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:03.976318 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1311/2634] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:03 2022] DELETE /identity/v3/projects/e7945e317ab24ea39ac42ebeb2f26aee => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:05.879897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:05.881333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:05.894766 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b461a5-bfe0-40bf-b68d-738dd7c90a80 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:05.952527 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:05.953461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:05.953813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:05.954562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] PATH_INFO: `/v3/users/81ab20729bb04b0dbea8e1931cf0eb85` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:05.955571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ab20729bb04b0dbea8e1931cf0eb85)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:05.961024 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:06.118797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:06.120368 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:06.134124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5422b8-14bb-46a8-8e7a-f09ff634322a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:06.138905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:06.139966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:06.140257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:06.140538 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] PATH_INFO: `/v3/users/ea2f2acc384e44358f9b2137e8e22c83` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:06.141768 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2f2acc384e44358f9b2137e8e22c83)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:06.143718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:06.194064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ab20729bb04b0dbea8e1931cf0eb85'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.201796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ab20729bb04b0dbea8e1931cf0eb85'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.202507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ab20729bb04b0dbea8e1931cf0eb85'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.215478 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ab20729bb04b0dbea8e1931cf0eb85'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.216572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-9849304d-7537-4434-b9ae-c0b28cfec5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ab20729bb04b0dbea8e1931cf0eb85'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.292851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1324/2635] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:05 2022] DELETE /identity/v3/users/81ab20729bb04b0dbea8e1931cf0eb85 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:06.297428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:06.297716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:06.298052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:06.316439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:06.317677 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:06.330828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2f2acc384e44358f9b2137e8e22c83'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.338631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2f2acc384e44358f9b2137e8e22c83'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.338765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:06.344461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2f2acc384e44358f9b2137e8e22c83'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.385891 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1325/2636] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:06.395557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:06.397021 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:06.426634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2f2acc384e44358f9b2137e8e22c83'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.434788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-c568ba19-256e-4153-aa77-c231cb8b4858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2f2acc384e44358f9b2137e8e22c83'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:06.441253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1312/2637] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:06 2022] DELETE /identity/v3/users/ea2f2acc384e44358f9b2137e8e22c83 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:06.445728 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051e4f-a438-401f-90b7-82b923420959 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:06.446207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051e4f-a438-401f-90b7-82b923420959 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:06.446627 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051e4f-a438-401f-90b7-82b923420959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:06.452871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:06.458337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d9c7-9bd9-4a95-97b6-b45f5c447ee3 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:06.466294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-86051e4f-a438-401f-90b7-82b923420959 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:06.467520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-86051e4f-a438-401f-90b7-82b923420959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:06.524988 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:06.526115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:06.526612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:06.527119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:06.533446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1313/2638] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:06.544329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:06.544557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051e4f-a438-401f-90b7-82b923420959 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:06.545843 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-86051e4f-a438-401f-90b7-82b923420959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:06.546110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:06.557370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1326/2639] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:06.562802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051e4f-a438-401f-90b7-82b923420959 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:06.564399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:06.565090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:06.565375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:06.565652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:06.576808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:06.578270 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:06.591297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1314/2640] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:07.036610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:07.038186 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:07.055688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef614e-3bbf-4b46-91c6-b7ab6b1f8b24 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:07.062938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:07.062938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:07.062938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:07.062938 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] PATH_INFO: `/v3/projects/97d6e829a356479482ab3eefe3508277` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:07.064107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d6e829a356479482ab3eefe3508277)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:07.065923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:07.088714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:07.090619 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:07.106531 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dab9c-d6a9-4a2b-8470-31e657e9d237 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:07.111470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:07.112508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:07.112798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:07.113083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] PATH_INFO: `/v3/projects/6821e6fc3bc94b76b6d6c16d667b52d5` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:07.114437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6821e6fc3bc94b76b6d6c16d667b52d5)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:07.116426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:07.222381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d6e829a356479482ab3eefe3508277', 'request_id': 'req-5d3eaf43-9fb6-43ad-bb74-5334bea42066'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.223963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6821e6fc3bc94b76b6d6c16d667b52d5', 'request_id': 'req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.297608 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d6e829a356479482ab3eefe3508277', 'request_id': 'req-5d3eaf43-9fb6-43ad-bb74-5334bea42066'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.304615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d6e829a356479482ab3eefe3508277', 'request_id': 'req-5d3eaf43-9fb6-43ad-bb74-5334bea42066'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.316416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] The token cache is being invalidate because project 97d6e829a356479482ab3eefe3508277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:07.316704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.317352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.318892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1327/2641] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:07 2022] DELETE /identity/v3/projects/97d6e829a356479482ab3eefe3508277 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:07.323686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:07.325069 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:07.331309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:07.386691 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6821e6fc3bc94b76b6d6c16d667b52d5', 'request_id': 'req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.392123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eaf43-9fb6-43ad-bb74-5334bea42066 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:07.393700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6821e6fc3bc94b76b6d6c16d667b52d5', 'request_id': 'req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.406923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] The token cache is being invalidate because project 6821e6fc3bc94b76b6d6c16d667b52d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:07.407216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.407924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.409506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1315/2642] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:07 2022] DELETE /identity/v3/projects/6821e6fc3bc94b76b6d6c16d667b52d5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:07.413470 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:07.416087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:07.459935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:07.460833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:07.461114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:07.461975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] PATH_INFO: `/v3/users/27caf3a9a78647498c7a38874f181961` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:07.464042 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27caf3a9a78647498c7a38874f181961)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:07.467738 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:07.492115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a407a37-82ff-4c58-a7c6-a8b4e7f34ad3 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:07.496820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:07.497699 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:07.497978 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:07.498250 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] PATH_INFO: `/v3/users/b7c21ec8df5946c193ab0963df850909` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:07.499455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c21ec8df5946c193ab0963df850909)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:07.501638 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:07.516142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:07.682727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27caf3a9a78647498c7a38874f181961'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.689768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27caf3a9a78647498c7a38874f181961'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.690431 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27caf3a9a78647498c7a38874f181961'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.706354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27caf3a9a78647498c7a38874f181961'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.707191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27caf3a9a78647498c7a38874f181961'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.717137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c21ec8df5946c193ab0963df850909'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.717799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c21ec8df5946c193ab0963df850909'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.737279 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c21ec8df5946c193ab0963df850909'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.792404 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1328/2643] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:07 2022] DELETE /identity/v3/users/27caf3a9a78647498c7a38874f181961 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:07.852142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c21ec8df5946c193ab0963df850909'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.859874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c21ec8df5946c193ab0963df850909'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:07.866426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1316/2644] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:07 2022] DELETE /identity/v3/users/b7c21ec8df5946c193ab0963df850909 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:08.306189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.306919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.309076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.309405 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.352854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:08.392483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd915-6447-4d4d-bd3b-227be80c0e2f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.392706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65ffab-6685-4a11-9f10-c5af28672950 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.397399 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.398223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.398501 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.398814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] PATH_INFO: `/v3/projects/2c687f5085094d2fb913cabcd336f05b` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.399008 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.400010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.403259 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c687f5085094d2fb913cabcd336f05b)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.403383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.403383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] PATH_INFO: `/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.403383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9b0b14d6e44d3984f041f2aa10ac0d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.403673 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.403776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.549154 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9b0b14d6e44d3984f041f2aa10ac0d', 'request_id': 'req-ee235901-d252-4cb0-af3f-2907f9df61b1'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.549387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c687f5085094d2fb913cabcd336f05b', 'request_id': 'req-8ded46f0-3e78-489a-a217-c5b3f66b8716'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.635408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c687f5085094d2fb913cabcd336f05b', 'request_id': 'req-8ded46f0-3e78-489a-a217-c5b3f66b8716'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.642675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c687f5085094d2fb913cabcd336f05b', 'request_id': 'req-8ded46f0-3e78-489a-a217-c5b3f66b8716'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.654778 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] The token cache is being invalidate because project 2c687f5085094d2fb913cabcd336f05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:08.655057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.655709 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8ded46f0-3e78-489a-a217-c5b3f66b8716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.657350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1329/2645] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:08 2022] DELETE /identity/v3/projects/2c687f5085094d2fb913cabcd336f05b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:08.662102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928a28-03a0-4bd3-b4a9-02384f5a643e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.662396 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928a28-03a0-4bd3-b4a9-02384f5a643e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.662674 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928a28-03a0-4bd3-b4a9-02384f5a643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.683344 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-65928a28-03a0-4bd3-b4a9-02384f5a643e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:08.684609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-65928a28-03a0-4bd3-b4a9-02384f5a643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.720604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9b0b14d6e44d3984f041f2aa10ac0d', 'request_id': 'req-ee235901-d252-4cb0-af3f-2907f9df61b1'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.729023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9b0b14d6e44d3984f041f2aa10ac0d', 'request_id': 'req-ee235901-d252-4cb0-af3f-2907f9df61b1'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.742686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] The token cache is being invalidate because project fb9b0b14d6e44d3984f041f2aa10ac0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:08.743009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.743765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ee235901-d252-4cb0-af3f-2907f9df61b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:08.745797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1317/2646] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:08 2022] DELETE /identity/v3/projects/fb9b0b14d6e44d3984f041f2aa10ac0d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:08.750289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf14e-c8e2-4003-a62a-3da6af084585 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.750577 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf14e-c8e2-4003-a62a-3da6af084585 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.750870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf14e-c8e2-4003-a62a-3da6af084585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.752786 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1330/2647] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:08.767992 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.768412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.768544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.771998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-9f4cf14e-c8e2-4003-a62a-3da6af084585 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:08.772800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9f4cf14e-c8e2-4003-a62a-3da6af084585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.790809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1318/2648] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:08.792837 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.793276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.793479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:08.793568 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.794794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.805486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1331/2649] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:08.809889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.816503 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:08.817812 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:08.819367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62b29-ce06-4baa-9de5-1318aaed4ff6 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.824148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.824912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.825101 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.825380 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.826120 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:08.826429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.828074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.831958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1319/2650] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:08.833089 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.846417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1332/2651] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:08.846633 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf702a-eb85-410e-b72b-3e9971cb3e66 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.847406 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.848431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.849111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.849534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.849821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.850566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:08.850882 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.853340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.856057 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:08.858140 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af167fce-6e91-4f3b-88ef-a631b42849e0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.862972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.863641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.863953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.864230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.864929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.866856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.867333 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1320/2652] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:08.871908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:08.882826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db361-7e95-48ef-90f4-541b6473312b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:08.888289 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:08.888957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:08.889242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:08.889516 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:08.890211 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:08.892142 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:08.998907 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1333/2653] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:09.000595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.011896 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1321/2654] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/projects => generated 393 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:09.016040 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.043364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:09.091082 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5349-95c6-4c67-bc04-c2deccf14d99 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.091707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5be79-5f82-47cf-b332-6cda361110d9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.095851 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.096530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.096675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.096798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.097070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.097264 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.097551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.097763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.097871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.098624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.099722 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.100520 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.206773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1334/2655] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:08 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:09.211002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.221447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8527a-7465-4cc4-8745-57fa447498d7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.226234 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.227482 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.228029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.228369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.229114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.230742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.241150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1335/2656] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:09.247902 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.255145 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1322/2657] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:09.259980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.261121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7400-dc47-4654-854b-33956b71feec admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.267536 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.268602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.268983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.269385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.270504 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.270789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b833ee-f773-48b9-b648-df36a8a816ca admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.272526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.276213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.276910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.277198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.277474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.278239 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.279965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.288784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1336/2658] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:09.291562 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1323/2659] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:09.295386 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.295579 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.306870 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f471b9-9f6a-4f54-ad31-3a8015f0351a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.307161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4400f-f9b0-41a0-a443-f06d181ab43c admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.314383 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.314614 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.315299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.315299 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.315634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.315791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.316003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.316259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] PATH_INFO: `/v3/projects/71132f7281234a5ebeea1327b68e3fd7/users/7509ed794c304acc8f95b40ec2e95565/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.316429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.318298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.328905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1337/2660] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:09.333439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.344020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71132f7281234a5ebeea1327b68e3fd7, user_id=7509ed794c304acc8f95b40ec2e95565, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.344364 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac56b4-094d-42fc-9927-cd53770809c4 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.348759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.349566 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c2999-e881-4f6d-88a2-78f75d2378e7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.349818 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.350032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.350309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] PATH_INFO: `/v3/projects/a083e4a0b94d45b0b00db4ab6aa821d7/users/e42cfdaed9c749588a8ca4315158f324/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.366811 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a083e4a0b94d45b0b00db4ab6aa821d7, user_id=e42cfdaed9c749588a8ca4315158f324, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.370148 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a1862-fd0e-41a7-bb62-f6cce5d9379c admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.429431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1324/2661] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:09 2022] PUT /identity/v3/projects/71132f7281234a5ebeea1327b68e3fd7/users/7509ed794c304acc8f95b40ec2e95565/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:09.439684 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.440007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.440290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.467783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] MFA Rules not processed for user `7509ed794c304acc8f95b40ec2e95565`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:09.469030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:09.486863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1338/2662] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:09 2022] PUT /identity/v3/projects/a083e4a0b94d45b0b00db4ab6aa821d7/users/e42cfdaed9c749588a8ca4315158f324/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:09.497671 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.497963 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.498241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.529971 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] MFA Rules not processed for user `e42cfdaed9c749588a8ca4315158f324`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:09.531205 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:09.543968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1325/2663] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:09.545717 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.573537 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:09.601502 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1339/2664] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:09.606928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.613707 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7861cce-7ec0-42db-948a-1a06423091d5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.654702 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:09.673495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d9459-e7e1-49ef-93eb-8d310448a525 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.674818 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.676853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.676853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.676853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.676853 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.678573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.678733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.679236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.679521 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.679814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.680573 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.682632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.774947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1326/2665] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:09.778914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.793614 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1340/2666] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:09.797610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.845486 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a940-e469-4a7a-a138-a10289749e84 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.864615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b99c05-2326-4bfa-aa59-86d596ffc93b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.869972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.870781 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.871129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.871369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.872119 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.874070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.899674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:09.905720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.906397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.906683 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.906962 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.907657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.909624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:09.971207 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1341/2667] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/users => generated 303 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:09.975230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:09.986745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f504784-3400-4e49-b19d-e9d26901bd3b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:09.991823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:09.992682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:09.993072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:09.993368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:09.994116 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:09.995755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.001134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1327/2668] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:09 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:10.004926 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.006712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1342/2669] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:10.011549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.015956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92964-5faa-42b3-bbae-e9223c14a383 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.021123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.021987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.022322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.022447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bd187-6cef-41fb-8075-65116045a0a9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.022606 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.023357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.025758 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.032506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.032506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.032506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.032506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] PATH_INFO: `/v3/projects/8a485d71a2044524b10e55a63dfe9e75/users/c3049c1270a2483eaf5d78e54479f53f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.036866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1328/2670] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:10.041259 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.045454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a485d71a2044524b10e55a63dfe9e75, user_id=c3049c1270a2483eaf5d78e54479f53f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.048238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.051190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c1a0d-362e-430d-a97e-21c82c78bead admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.057258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.058417 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.058703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.061043 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] PATH_INFO: `/v3/projects/01373a4b05f04829b463f7c15df264d5/users/bb0122f147cb4352ad1751c70ebe918a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.075521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01373a4b05f04829b463f7c15df264d5, user_id=bb0122f147cb4352ad1751c70ebe918a, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.078236 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.150037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1343/2671] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:10 2022] PUT /identity/v3/projects/8a485d71a2044524b10e55a63dfe9e75/users/c3049c1270a2483eaf5d78e54479f53f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:10.150931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.152646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.173348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1329/2672] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:10 2022] PUT /identity/v3/projects/01373a4b05f04829b463f7c15df264d5/users/bb0122f147cb4352ad1751c70ebe918a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:10.174245 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.225505 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9142-35bc-45bb-8584-98d1c7735369 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.241183 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568351e-0f04-4993-b7c7-2d82958b70f7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.246762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.247444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.247730 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.248046 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.248791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.250409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.253534 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:10.264775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1330/2673] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:10.264775 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.273104 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b9c5-73b6-4065-80e0-a0a9df8f2ba7 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.278195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.278908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.279361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.279648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.280416 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.282024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.289028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.289962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.290256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.290538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] PATH_INFO: `/v3/users/647f63660ab5468faace58d69740609e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.291783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647f63660ab5468faace58d69740609e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.293012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1331/2674] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:10.293768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.293880 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.304225 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b2144-7ce4-403f-bac7-9965ff9e59f0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.310782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.311799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.312207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.312492 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] PATH_INFO: `/v3/projects/8a485d71a2044524b10e55a63dfe9e75/users/c3049c1270a2483eaf5d78e54479f53f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.314712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a485d71a2044524b10e55a63dfe9e75, user_id=c3049c1270a2483eaf5d78e54479f53f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.317587 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.329913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1332/2675] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:10 2022] PUT /identity/v3/projects/8a485d71a2044524b10e55a63dfe9e75/users/c3049c1270a2483eaf5d78e54479f53f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:10.330762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.396750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a40d7-15af-4728-aced-f6072d3b8e44 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.402316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.403353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.403651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.403960 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] PATH_INFO: `/v3/projects/01373a4b05f04829b463f7c15df264d5/users/bb0122f147cb4352ad1751c70ebe918a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.406015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01373a4b05f04829b463f7c15df264d5, user_id=bb0122f147cb4352ad1751c70ebe918a, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.408760 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3cebc-557b-4ace-96f2-b9f03af85a75 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.420929 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1333/2676] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:10 2022] PUT /identity/v3/projects/01373a4b05f04829b463f7c15df264d5/users/bb0122f147cb4352ad1751c70ebe918a/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:10.422311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56126fdf-b4f6-455a-9de4-2eba3c6e986b None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.422603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56126fdf-b4f6-455a-9de4-2eba3c6e986b None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.422886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56126fdf-b4f6-455a-9de4-2eba3c6e986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.450756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-56126fdf-b4f6-455a-9de4-2eba3c6e986b None None] MFA Rules not processed for user `c3049c1270a2483eaf5d78e54479f53f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:10.453979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-56126fdf-b4f6-455a-9de4-2eba3c6e986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.457252 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:10.489361 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647f63660ab5468faace58d69740609e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:10.497464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647f63660ab5468faace58d69740609e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:10.498199 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647f63660ab5468faace58d69740609e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:10.511210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647f63660ab5468faace58d69740609e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:10.511923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647f63660ab5468faace58d69740609e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:10.524957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1334/2677] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:10.526374 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88214-34fb-4a32-b4bb-3de891ebe885 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.526662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88214-34fb-4a32-b4bb-3de891ebe885 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.526936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88214-34fb-4a32-b4bb-3de891ebe885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.553429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-deb88214-34fb-4a32-b4bb-3de891ebe885 None None] MFA Rules not processed for user `bb0122f147cb4352ad1751c70ebe918a`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:10.557215 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-deb88214-34fb-4a32-b4bb-3de891ebe885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.582191 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1344/2678] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:10 2022] DELETE /identity/v3/users/647f63660ab5468faace58d69740609e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:10.582808 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.584214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.628365 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1335/2679] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:10.632657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.632657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.632657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.645632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5a90-4396-4174-9150-c26aa3fda316 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.650099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.650759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.651040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.651313 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.655535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:10.657450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.717000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.718472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.721675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1336/2680] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:10.722652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.723000 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:10.727564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.739328 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1345/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:10.740968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.744385 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9756f-a325-46a7-99b4-2fa861ae97f6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.744523 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.748819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.749689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.750039 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.750901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.787500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:10.816947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d0f5-0ac4-4571-bca2-789c505e94df service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.821690 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.822358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.822641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.822916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.824095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.825585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.833229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.834829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.837434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1337/2682] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:10.839085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.847480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1346/2683] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:10.848253 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b708637-8ae9-4d6b-ac42-015188b945f0 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.852693 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.853354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.853647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.853956 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.855889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.913787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:10.915923 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:10.929974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9fa82-dec4-46e2-a243-557cdf308f62 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:10.930422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.937715 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13744ae-fe8a-4e2e-beea-dae6871df478 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.942281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:10.943349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:10.943763 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:10.944178 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] PATH_INFO: `/v3/users/7509ed794c304acc8f95b40ec2e95565` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:10.945832 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7509ed794c304acc8f95b40ec2e95565)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:10.948170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:10.948943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1338/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:11.178237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7509ed794c304acc8f95b40ec2e95565'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.185147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7509ed794c304acc8f95b40ec2e95565'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.186113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7509ed794c304acc8f95b40ec2e95565'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.201220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7509ed794c304acc8f95b40ec2e95565'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.201865 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7509ed794c304acc8f95b40ec2e95565'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.292227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1347/2685] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:10 2022] DELETE /identity/v3/users/7509ed794c304acc8f95b40ec2e95565 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:11.297019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.297335 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.297656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.316068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:11.322781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.354759 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:11.359254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.392541 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1339/2686] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:11.407501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:11.409099 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.450348 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff7e4-7aa3-4f42-aa5c-15a76a8d6b54 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:11.455037 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:11.456017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.456255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.456522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] PATH_INFO: `/v3/projects/ddfa48ba43cf4c8eb02bd400a32bc965` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.457765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfa48ba43cf4c8eb02bd400a32bc965)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:11.459686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:11.473218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7340-a52e-481d-80b6-b21890c9baec None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:11.478103 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:11.478682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.478809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.479017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.479143 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:11.488869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:11.490399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d3ea-c765-4186-94f3-104c99c4e2a1 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:11.500444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1340/2687] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:11.612098 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfa48ba43cf4c8eb02bd400a32bc965', 'request_id': 'req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.685179 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfa48ba43cf4c8eb02bd400a32bc965', 'request_id': 'req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.693848 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfa48ba43cf4c8eb02bd400a32bc965', 'request_id': 'req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.707571 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] The token cache is being invalidate because project ddfa48ba43cf4c8eb02bd400a32bc965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:11.707899 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.709244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f8cd4ea1-f151-4260-9174-27f9dcb0b3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:11.711526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1348/2688] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:11 2022] DELETE /identity/v3/projects/ddfa48ba43cf4c8eb02bd400a32bc965 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:11.716947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.717364 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.717535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.725326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:11.741513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:11.743564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.813652 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1341/2689] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:11.822168 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.822468 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.822742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.842721 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:11.844020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.852906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1349/2690] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:11.856961 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:11.868208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23e64-2167-4281-b38d-ce225473c2d5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:11.873590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:11.874276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.874582 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.874860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.875609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:11.875959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:11.877556 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:11.891000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1342/2691] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:11.895693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:11.906245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac74235-51cc-43be-85d3-9eb2e971ed8f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:11.910926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:11.911581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.911894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.912172 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.912983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:11.916072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:11.966835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:11.969198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:11.990353 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ad81-c806-4eeb-a2dc-b033273becb6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:11.995869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:11.996883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:11.997209 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:11.997529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] PATH_INFO: `/v3/projects/71132f7281234a5ebeea1327b68e3fd7` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:11.998857 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=71132f7281234a5ebeea1327b68e3fd7)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:11.999735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1350/2692] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:11 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:12.001100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.005967 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.080830 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d141-d9db-4708-b4a8-497612010b61 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.085642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.086930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.087216 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.087493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.088244 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.090253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.136778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71132f7281234a5ebeea1327b68e3fd7', 'request_id': 'req-dd456d79-53a7-447d-af6b-5fd6d381fdda'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.204793 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1351/2693] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:12 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:12.208622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.219293 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803a48d-65e2-4829-a4ef-d912281ed52d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.226281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71132f7281234a5ebeea1327b68e3fd7', 'request_id': 'req-dd456d79-53a7-447d-af6b-5fd6d381fdda'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.234469 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71132f7281234a5ebeea1327b68e3fd7', 'request_id': 'req-dd456d79-53a7-447d-af6b-5fd6d381fdda'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.249134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] The token cache is being invalidate because project 71132f7281234a5ebeea1327b68e3fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:12.249670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.250583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.252602 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1343/2694] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:11 2022] DELETE /identity/v3/projects/71132f7281234a5ebeea1327b68e3fd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:12.256234 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.258872 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:12.283443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.284158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.284437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.284710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.285440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.287077 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.292883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.298055 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1352/2695] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:12.305617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.305617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:12.318484 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917039a-7960-47e7-ae4b-77b07772cea8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.324920 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.325594 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.325959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.326260 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.327062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.328710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.329632 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456d79-53a7-447d-af6b-5fd6d381fdda admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.334890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.335782 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.336127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.336409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] PATH_INFO: `/v3/users/bb0122f147cb4352ad1751c70ebe918a` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.337876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0122f147cb4352ad1751c70ebe918a)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.340041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.343580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1353/2696] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:12.344445 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.356439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022829e-ffe7-49db-9255-395722c6f8ba admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.358663 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.362842 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.363746 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.364535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.364764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] PATH_INFO: `/v3/projects/ca8606259f314e2bb9f04cd8c3fc7b5a/users/b61c808beccc4586b41f6af3312743fd/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.381623 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8606259f314e2bb9f04cd8c3fc7b5a, user_id=b61c808beccc4586b41f6af3312743fd, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.384461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e572da-7c06-4e17-a075-caf679b61453 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.462377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1354/2697] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:12 2022] PUT /identity/v3/projects/ca8606259f314e2bb9f04cd8c3fc7b5a/users/b61c808beccc4586b41f6af3312743fd/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:12.473511 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.473800 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.477535 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.502556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] MFA Rules not processed for user `b61c808beccc4586b41f6af3312743fd`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:12.503710 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:12.526185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0122f147cb4352ad1751c70ebe918a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.526869 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0122f147cb4352ad1751c70ebe918a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.538979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0122f147cb4352ad1751c70ebe918a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.573326 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1355/2698] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:12.584635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:12.586050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:12.629524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0122f147cb4352ad1751c70ebe918a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.637771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0122f147cb4352ad1751c70ebe918a'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:12.643949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1344/2699] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:12 2022] DELETE /identity/v3/users/bb0122f147cb4352ad1751c70ebe918a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:12.644488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97007fb4-7fa3-45ab-8b0e-670fee7a326c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:12.703284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:12.703284 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:12.703507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:12.703772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:12.740798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.776783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:12.778251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e888b1-07e3-45aa-965d-bee0c7efd0f3 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:12.787859 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1356/2700] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:13.126028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:13.126454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:13.202996 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6976a-64bc-4f52-afde-66d802dfabe8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:13.207876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:13.208878 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.209164 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.209456 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] PATH_INFO: `/v3/projects/01373a4b05f04829b463f7c15df264d5` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.210751 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=01373a4b05f04829b463f7c15df264d5)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:13.213265 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:13.363340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01373a4b05f04829b463f7c15df264d5', 'request_id': 'req-629c8198-57e3-4d4d-ae38-99e4fb60d4db'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:13.457705 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01373a4b05f04829b463f7c15df264d5', 'request_id': 'req-629c8198-57e3-4d4d-ae38-99e4fb60d4db'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:13.465783 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01373a4b05f04829b463f7c15df264d5', 'request_id': 'req-629c8198-57e3-4d4d-ae38-99e4fb60d4db'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:13.479712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] The token cache is being invalidate because project 01373a4b05f04829b463f7c15df264d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:13.480034 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:13.480703 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-629c8198-57e3-4d4d-ae38-99e4fb60d4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:13.482561 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1345/2701] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:13 2022] DELETE /identity/v3/projects/01373a4b05f04829b463f7c15df264d5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:13.487792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.488060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.488349 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.509170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:13.510472 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:13.584084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1357/2702] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:13.593179 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.593471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.593803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.619539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:13.620924 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:13.629804 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1346/2703] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:13.634953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:13.645375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca44061-ef9b-4d74-ab3d-57e1653e735e None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:13.651158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:13.652026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.652274 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.652556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.653314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:13.653626 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:13.655433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:13.671839 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1358/2704] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:13.673868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:13.685493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900552-6d48-4c8d-ae93-181d2aa1379a None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:13.693820 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:13.694589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.695028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.695307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.696850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:13.698824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:13.718354 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:13.788409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1347/2705] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:13 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:13.792796 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:13.803213 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2370dc-6274-44a3-99e1-22c41433c9ac admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:13.864982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:13.865760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.866147 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.866433 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.867158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:13.870170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:13.944825 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1359/2706] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:13 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:13.953411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:13.964963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a452-b4e8-4574-ba83-7b6e082e0296 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:13.969624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:13.970309 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:13.970626 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:13.970891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:13.971615 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:13.973654 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:13.985281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1348/2707] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:13.989321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.000467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c93d-cf92-4e6a-ad5a-3e568fa33fa2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.005492 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.006389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.006515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.008682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.008682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.009455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fcd0-3bb4-42ca-803c-887c9502ea7a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.020080 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1360/2708] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:14.025202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.035172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e27ac-0104-4c0b-b044-5db030ac2c09 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.040464 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.041362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.041643 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.041967 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] PATH_INFO: `/v3/projects/28dcb66699424fd2be17021bfeb495ec/users/563ab8b53b40449f83673fa6817a948c/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.059569 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dcb66699424fd2be17021bfeb495ec, user_id=563ab8b53b40449f83673fa6817a948c, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.062258 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.186917 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1349/2709] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:14 2022] PUT /identity/v3/projects/28dcb66699424fd2be17021bfeb495ec/users/563ab8b53b40449f83673fa6817a948c/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:14.195174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.195467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.195749 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.225020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] MFA Rules not processed for user `563ab8b53b40449f83673fa6817a948c`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:14.226251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:14.246612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:14.293436 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1361/2710] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:14.298051 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.361589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec3b1e-2183-4f53-85ac-2b20f5385558 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.366506 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.367168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.367477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.367795 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.368551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.370448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.482564 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1350/2711] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:14 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:14.487048 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.498477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846587-0ef2-482a-90de-f466345c32a4 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.555238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.555941 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.556230 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.556549 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.557294 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.559617 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.635755 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1362/2712] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:14 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:14.639731 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.650793 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402e06-85b5-4c65-9286-45cbccb751f2 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.655513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.656452 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.656741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.657083 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.657842 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.659496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.671576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1351/2713] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:14.675999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.687889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45922b-1992-4f17-873e-0ce0dff6b6c8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.692704 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.693602 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.693888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.694166 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] PATH_INFO: `/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50/users/7aafd3e133b34ac6ba8049802ffb672f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.710801 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a632d8b8221459b9ee96d2fcdda5f50, user_id=7aafd3e133b34ac6ba8049802ffb672f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.713616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.785371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1363/2714] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:14 2022] PUT /identity/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50/users/7aafd3e133b34ac6ba8049802ffb672f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:14.788194 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.799055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f0874-a473-42f6-b06e-da4a7600692b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.859745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.860446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.860748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.861007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.861738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.863376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c2276-1975-4df6-aceb-014c3e7e65ee admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.874987 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1352/2715] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:14.879442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:14.890775 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1966e3-109d-492d-8c15-e2fb9d7c715f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:14.895432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:14.896352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.896628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.896898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] PATH_INFO: `/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50/users/7aafd3e133b34ac6ba8049802ffb672f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.898854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a632d8b8221459b9ee96d2fcdda5f50, user_id=7aafd3e133b34ac6ba8049802ffb672f, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:14.901723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:14.912210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1364/2716] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:14 2022] PUT /identity/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50/users/7aafd3e133b34ac6ba8049802ffb672f/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:14.923332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:14.923629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:14.923957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:14.952445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] MFA Rules not processed for user `7aafd3e133b34ac6ba8049802ffb672f`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:14.953666 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:14.973087 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:15.022909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1353/2717] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:15.035821 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:15.037587 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:15.097076 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab378a-8288-4fcb-b352-4b373caec746 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:15.100904 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:15.101566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:15.101916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:15.102193 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:15.113276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:15.114739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:15.125566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1365/2718] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:16.003686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.005203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:16.071829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1922-8d04-48ca-8ef2-f5103ab2dbf6 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.076851 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.077773 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.078053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.078325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] PATH_INFO: `/v3/users/e42cfdaed9c749588a8ca4315158f324` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.079534 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42cfdaed9c749588a8ca4315158f324)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.081494 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.279531 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.288845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb508e-8705-487c-aeed-917fb6eeff74 service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.294520 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aafd3e133b34ac6ba8049802ffb672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a632d8b8221459b9ee96d2fcdda5f50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.295173 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.295456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.295734 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.296509 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:16.296819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.298424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.311058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1366/2719] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:16.314858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.319886 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:16.325375 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f00344-4cb8-4af3-bef7-b69827bbf347 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.329964 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aafd3e133b34ac6ba8049802ffb672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a632d8b8221459b9ee96d2fcdda5f50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.330649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.330933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.331210 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.331926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.333853 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.359117 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42cfdaed9c749588a8ca4315158f324'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.359690 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42cfdaed9c749588a8ca4315158f324'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.371899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42cfdaed9c749588a8ca4315158f324'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.455656 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42cfdaed9c749588a8ca4315158f324'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.468697 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1367/2720] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:16 2022] POST /identity/v3/projects => generated 354 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:16.468832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8ca762d4-2388-431c-aeca-afc8b738a349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42cfdaed9c749588a8ca4315158f324'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.470833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.472540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:16.476341 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1354/2721] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:16 2022] DELETE /identity/v3/users/e42cfdaed9c749588a8ca4315158f324 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:16.479336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.479628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.479985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.499133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:16.500098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:16.534868 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:16.551398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa3-e4f2-45a5-b5b8-092cd147bdb4 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.565357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1355/2722] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:16.576395 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.577817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:16.614374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aafd3e133b34ac6ba8049802ffb672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a632d8b8221459b9ee96d2fcdda5f50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.615087 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.615377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.615660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.616444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:16.616757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.618606 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.637001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1368/2723] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:16.647352 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422cba-4a3b-4e73-8c43-55ffe2a1b500 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.652454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.653147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.653462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.653741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.663429 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.664965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.675175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1356/2724] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:16.675486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:16.686295 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae824ae-bb9f-47ac-b7e4-9440555b7907 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:16.691217 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aafd3e133b34ac6ba8049802ffb672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a632d8b8221459b9ee96d2fcdda5f50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:16.692183 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:16.692695 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:16.693040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] PATH_INFO: `/v3/projects/33169132b6d94d79a05138d44a420575` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:16.694302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33169132b6d94d79a05138d44a420575)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:16.696408 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:16.825015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33169132b6d94d79a05138d44a420575', 'request_id': 'req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.886649 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33169132b6d94d79a05138d44a420575', 'request_id': 'req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.895115 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33169132b6d94d79a05138d44a420575', 'request_id': 'req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.906944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] The token cache is being invalidate because project 33169132b6d94d79a05138d44a420575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:16.907319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.908043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:16.909619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1369/2725] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:16 2022] DELETE /identity/v3/projects/33169132b6d94d79a05138d44a420575 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:17.133905 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:17.135604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:17.150975 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a29e80-bafc-447d-82f3-d38208881e4a service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:17.221207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:17.222074 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:17.222347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:17.222647 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] PATH_INFO: `/v3/projects/a083e4a0b94d45b0b00db4ab6aa821d7` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:17.223919 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a083e4a0b94d45b0b00db4ab6aa821d7)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:17.225860 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:17.334472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a083e4a0b94d45b0b00db4ab6aa821d7', 'request_id': 'req-4fff620e-37e3-401f-bb5e-42b2179bed8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.417874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a083e4a0b94d45b0b00db4ab6aa821d7', 'request_id': 'req-4fff620e-37e3-401f-bb5e-42b2179bed8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.424986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a083e4a0b94d45b0b00db4ab6aa821d7', 'request_id': 'req-4fff620e-37e3-401f-bb5e-42b2179bed8c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.437446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] The token cache is being invalidate because project a083e4a0b94d45b0b00db4ab6aa821d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:17.437801 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.438399 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.440137 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1357/2726] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:17 2022] DELETE /identity/v3/projects/a083e4a0b94d45b0b00db4ab6aa821d7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:17.444296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:17.445968 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:17.456584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:17.462123 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffefc46-beeb-4be8-a70c-c2e6c6d10903 tempest-VolumeQuotaClassesTest-820369705 tempest-VolumeQuotaClassesTest-820369705-project-admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:17.519376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:17.520362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:17.520757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:17.521034 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] PATH_INFO: `/v3/users/c3049c1270a2483eaf5d78e54479f53f` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:17.522263 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3049c1270a2483eaf5d78e54479f53f)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:17.524228 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:17.596237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:17.597729 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:17.610840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff620e-37e3-401f-bb5e-42b2179bed8c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:17.615767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:17.616734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:17.617022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:17.617297 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] PATH_INFO: `/v3/users/563ab8b53b40449f83673fa6817a948c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:17.618509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=563ab8b53b40449f83673fa6817a948c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:17.622189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:17.624855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:17.766329 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3049c1270a2483eaf5d78e54479f53f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.773310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3049c1270a2483eaf5d78e54479f53f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.773980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3049c1270a2483eaf5d78e54479f53f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.785742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3049c1270a2483eaf5d78e54479f53f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.786397 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-f18cd7b5-2cb8-4e03-bcc6-7bd8ab0593eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3049c1270a2483eaf5d78e54479f53f'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.877784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1370/2727] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:17 2022] DELETE /identity/v3/users/c3049c1270a2483eaf5d78e54479f53f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:17.890624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563ab8b53b40449f83673fa6817a948c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.891282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563ab8b53b40449f83673fa6817a948c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.904603 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563ab8b53b40449f83673fa6817a948c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.987030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563ab8b53b40449f83673fa6817a948c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:17.995892 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563ab8b53b40449f83673fa6817a948c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.002213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1358/2728] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:17 2022] DELETE /identity/v3/users/563ab8b53b40449f83673fa6817a948c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:18.006973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.007271 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.007557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.025515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:18.026748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.088610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1371/2729] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:18.098235 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.100528 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.165855 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93ed8-98e1-4c2d-8c6f-4ad3ab6081dd admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:18.170767 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:18.171241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.171547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.171989 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.189724 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:18.191993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db773d1-d77c-404e-aca8-9d33da973c10 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:18.202951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1359/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:18.334973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.341489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.374298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69d18-d8a2-4286-a8ad-c3c030e67d28 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:18.380114 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:18.381236 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.381545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.381916 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] PATH_INFO: `/v3/projects/8a485d71a2044524b10e55a63dfe9e75` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.383287 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a485d71a2044524b10e55a63dfe9e75)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:18.385983 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:18.412039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:18.509277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a485d71a2044524b10e55a63dfe9e75', 'request_id': 'req-a4b2a078-dafb-4fc0-a96d-b9198c1af345'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.586969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a485d71a2044524b10e55a63dfe9e75', 'request_id': 'req-a4b2a078-dafb-4fc0-a96d-b9198c1af345'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.596440 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a485d71a2044524b10e55a63dfe9e75', 'request_id': 'req-a4b2a078-dafb-4fc0-a96d-b9198c1af345'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.611029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] The token cache is being invalidate because project 8a485d71a2044524b10e55a63dfe9e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:18.611561 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.612442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a4b2a078-dafb-4fc0-a96d-b9198c1af345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.614477 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1372/2731] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:18 2022] DELETE /identity/v3/projects/8a485d71a2044524b10e55a63dfe9e75 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:18.619161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.619460 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.619742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.638891 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:18.640311 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.706480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1360/2732] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:18.714731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.715092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.715377 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.735020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:18.736290 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.756676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1373/2733] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:18.760336 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.761866 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.766529 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:18.779126 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8a19f-85ce-4e37-a3cc-1dce0be2f896 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:18.788287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c7c2d-1f41-4913-895f-f122d4c3852e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:18.791102 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:18.792177 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.792458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.792835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.793653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:18.793961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:18.795572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:18.796431 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:18.797450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.797813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.798167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] PATH_INFO: `/v3/projects/28dcb66699424fd2be17021bfeb495ec` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.799555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dcb66699424fd2be17021bfeb495ec)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:18.801604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:18.809150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1374/2734] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:18.815198 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.826628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f6907-c64e-4a18-8695-bd9abf53b174 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:18.832028 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:18.835052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:18.835789 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:18.836155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:18.836488 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:18.837243 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:18.840085 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:18.908324 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dcb66699424fd2be17021bfeb495ec', 'request_id': 'req-f726ac7d-9c9e-46af-9e76-d34327f35db0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.935132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1375/2735] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:18 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:18.938141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:18.983310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dcb66699424fd2be17021bfeb495ec', 'request_id': 'req-f726ac7d-9c9e-46af-9e76-d34327f35db0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:18.990345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dcb66699424fd2be17021bfeb495ec', 'request_id': 'req-f726ac7d-9c9e-46af-9e76-d34327f35db0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.008011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] The token cache is being invalidate because project 28dcb66699424fd2be17021bfeb495ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:19.008197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.009479 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.011985 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1361/2736] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:18 2022] DELETE /identity/v3/projects/28dcb66699424fd2be17021bfeb495ec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:19.015862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.017540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:19.024514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568cbe-1ff9-4c57-8442-94aeffcb9d8f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.029103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.030256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.030816 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.031094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.031797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.034368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.093508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ac7d-9c9e-46af-9e76-d34327f35db0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.098634 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.099473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.099756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.100060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] PATH_INFO: `/v3/users/7aafd3e133b34ac6ba8049802ffb672f` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.101317 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aafd3e133b34ac6ba8049802ffb672f)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.103306 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.178409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1376/2737] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:18 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:19.183338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.185359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:19.197856 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4224e8-37a5-44a5-b19c-a14b3e280c89 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.203537 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.204239 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.204539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.204814 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.205544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.207165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.218155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1377/2738] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:19.222417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.233861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345d3b1-3b0e-43fd-aeb7-c5a1b95d59de admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.240850 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.241554 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.241991 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.242298 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.243428 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.251113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.261317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1378/2739] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:19.265888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.276005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c9a8-c7ce-4010-ac23-082eb7e0fd76 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.280915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.281790 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.282064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.282335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] PATH_INFO: `/v3/projects/4965b5675a4040bdae7932950542fd56/users/883fadeb67174161bd128a26473a98bf/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.297526 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4965b5675a4040bdae7932950542fd56, user_id=883fadeb67174161bd128a26473a98bf, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.300481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b88ec-dff0-4740-b03c-259f30687fe5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.350508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aafd3e133b34ac6ba8049802ffb672f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.351254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aafd3e133b34ac6ba8049802ffb672f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.363952 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aafd3e133b34ac6ba8049802ffb672f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.374390 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1379/2740] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:19 2022] PUT /identity/v3/projects/4965b5675a4040bdae7932950542fd56/users/883fadeb67174161bd128a26473a98bf/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:19.384827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.385113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.385388 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.406473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:19.423010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] MFA Rules not processed for user `883fadeb67174161bd128a26473a98bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:19.423010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:19.469339 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aafd3e133b34ac6ba8049802ffb672f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.478797 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aafd3e133b34ac6ba8049802ffb672f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:19.486058 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1362/2741] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:19 2022] DELETE /identity/v3/users/7aafd3e133b34ac6ba8049802ffb672f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:19.489631 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1380/2742] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:19.495479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.498873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:19.578060 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e2a1a-5cda-47b2-8904-dfdb97da3e32 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.634844 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.635772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.636081 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.636413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.637139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.639125 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.780837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1381/2743] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:19 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:19.784789 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:19.796446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e1c4a-255e-493c-a6b3-4cbf94d527e8 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:19.826743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:19.864523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:19.865214 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:19.865500 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:19.865777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:19.866489 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:19.868461 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:19.999937 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1363/2744] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:19 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:20.000058 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.002493 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.003562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:20.019237 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc691c-1b54-4d3e-a6fc-7173b4cae9b9 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.024712 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.026935 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.028412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.028412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] PATH_INFO: `/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.028623 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74b0d-d75a-4863-900f-36a8576b20da admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.029760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a632d8b8221459b9ee96d2fcdda5f50)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.034020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.034370 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.034833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.035190 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.035521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.036886 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.038968 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.053430 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1364/2745] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:20.058305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.074054 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e146-a0b4-4ded-83e0-256fa893f2b6 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.079819 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.080502 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.080785 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.081062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.081786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.083392 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.094999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1365/2746] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:20.098986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.112510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860ceab-b795-4a98-a3d5-3e04db28d462 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.117560 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.118580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.118865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.120096 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] PATH_INFO: `/v3/projects/100ba276d9f24dc28872f50929f45458/users/2a95fe258b70472cafc9647e61e29f86/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.135084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ba276d9f24dc28872f50929f45458, user_id=2a95fe258b70472cafc9647e61e29f86, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.138191 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac040cc-7263-40c2-adcb-36029582cf35 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.148447 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:20.213296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1366/2747] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:20 2022] PUT /identity/v3/projects/100ba276d9f24dc28872f50929f45458/users/2a95fe258b70472cafc9647e61e29f86/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:20.222189 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a632d8b8221459b9ee96d2fcdda5f50', 'request_id': 'req-961ae672-b54e-44ca-a89e-5d0be6b81378'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:20.225025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.225256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.228242 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.253381 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] MFA Rules not processed for user `2a95fe258b70472cafc9647e61e29f86`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:20.256814 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:20.304333 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a632d8b8221459b9ee96d2fcdda5f50', 'request_id': 'req-961ae672-b54e-44ca-a89e-5d0be6b81378'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:20.318585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a632d8b8221459b9ee96d2fcdda5f50', 'request_id': 'req-961ae672-b54e-44ca-a89e-5d0be6b81378'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:20.333282 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1367/2748] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:20.337317 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] The token cache is being invalidate because project 4a632d8b8221459b9ee96d2fcdda5f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:20.337860 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:20.339787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-961ae672-b54e-44ca-a89e-5d0be6b81378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:20.340451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.342580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1382/2749] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:19 2022] DELETE /identity/v3/projects/4a632d8b8221459b9ee96d2fcdda5f50 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:20.349880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741b5-b56f-4cc9-bf0e-41121cb61146 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.350358 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741b5-b56f-4cc9-bf0e-41121cb61146 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.350822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741b5-b56f-4cc9-bf0e-41121cb61146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.377385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-145741b5-b56f-4cc9-bf0e-41121cb61146 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:20.379302 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-145741b5-b56f-4cc9-bf0e-41121cb61146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:20.434184 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eb20-48d3-4e85-a3c5-bae6d9445b96 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.439075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.439833 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.440197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.440547 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.441314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.443276 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.447467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:20.454956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1383/2750] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:20.463029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.463346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.465246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.483124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:20.484493 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:20.500137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1384/2751] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:20.500137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.506323 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac043c-2ce6-46b4-a08f-f1fe741ffa48 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.511694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.512446 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.512815 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.513107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.513754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:20.514073 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.515646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.528439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1385/2752] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:20.532927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.542767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaf99-8727-4560-a429-c1c014eb2a06 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.549769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.549769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.549769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.549769 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.550246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.551219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.560176 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1368/2753] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:20.567207 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.569411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:20.637228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3dc8-2f9e-4b4a-a1f7-79fc18ea90e1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.641950 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.642628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.642911 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.643188 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.643920 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.645947 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.676725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1386/2754] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:20.678357 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.742419 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1369/2755] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:20.743572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19543c-8159-4732-96c6-42eca862401b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.746597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.748574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.749277 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.749562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.749868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.750530 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.752751 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.756580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd81f6f-2660-4f64-a7d5-85e230ccc999 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.761903 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.762574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.762850 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.763126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.763901 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.765499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.779700 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1370/2756] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:20.783351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.793914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139cc4-4614-4294-b563-672ad4bcfa93 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.798712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.806480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.806480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.806480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] PATH_INFO: `/v3/projects/07180a10bbb34952b85787ce0cb67db3/users/eb8048afc4e94a058e27bc4a7ef6478d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.815835 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07180a10bbb34952b85787ce0cb67db3, user_id=eb8048afc4e94a058e27bc4a7ef6478d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.818467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.834975 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1387/2757] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:20 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:20.841426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.846394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:20.851733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58089beb-afc1-4693-87ef-f462576c0928 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.856829 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.857479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.857762 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.858040 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.858774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.860414 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.870544 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1388/2758] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:20.874459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.884103 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba514a-d651-441a-bab8-6f46f5a4577a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.889545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.890190 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.890471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.890750 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.891467 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.893124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.904754 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1389/2759] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:20.908783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.918641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc651-846c-4291-8e00-1247ada4bbc2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:20.924343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:20.925215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:20.925496 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:20.925799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] PATH_INFO: `/v3/projects/a7967ef63bc344bca017a5e411ee6ba8/users/ce2b8b0dd2f84cc88c88738bc4a09c5e/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:20.927060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1371/2760] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:20 2022] PUT /identity/v3/projects/07180a10bbb34952b85787ce0cb67db3/users/eb8048afc4e94a058e27bc4a7ef6478d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:20.930830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:20.943013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7967ef63bc344bca017a5e411ee6ba8, user_id=ce2b8b0dd2f84cc88c88738bc4a09c5e, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:20.945889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b2f7e-6cac-4e41-b65a-73ab92881a3d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:20.995791 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe893-fc72-4548-9c33-6a5b90b43954 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.000480 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.001171 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.001514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.001802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.002540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.004192 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.015355 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1372/2761] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:21.019370 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.029321 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb55a1-562f-4b26-a07f-2862cdc05e49 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.034012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.034883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.035167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.035444 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] PATH_INFO: `/v3/projects/07180a10bbb34952b85787ce0cb67db3/users/eb8048afc4e94a058e27bc4a7ef6478d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.037508 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07180a10bbb34952b85787ce0cb67db3, user_id=eb8048afc4e94a058e27bc4a7ef6478d, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.040217 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fb9de-f5b3-465e-9a2f-2f99155fcdf8 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.051774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1373/2762] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:21 2022] PUT /identity/v3/projects/07180a10bbb34952b85787ce0cb67db3/users/eb8048afc4e94a058e27bc4a7ef6478d/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:21.063100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.063396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.063685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.076369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1390/2763] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:20 2022] PUT /identity/v3/projects/a7967ef63bc344bca017a5e411ee6ba8/users/ce2b8b0dd2f84cc88c88738bc4a09c5e/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:21.086995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.087620 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.088111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.093879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] MFA Rules not processed for user `eb8048afc4e94a058e27bc4a7ef6478d`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:21.095182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.105462 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:21.118630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] MFA Rules not processed for user `ce2b8b0dd2f84cc88c88738bc4a09c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:21.120517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.167660 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1374/2764] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:21.179004 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.180549 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.191155 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1391/2765] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:21.197670 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.243316 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc049dd-c687-4ab0-bee9-33f0c2380ec5 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.248133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.248727 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.249010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.249290 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.259160 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.261216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.266067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03392dee-aae1-43f9-97eb-8dfec5aac3bb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.270725 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.271189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1375/2766] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:21.271443 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.271653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.271958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.272681 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.274619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.373127 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.374617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.383555 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1392/2767] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:21 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:21.386277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0a23-499d-47f0-807f-d576eba31212 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.389104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.422944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:21.437742 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.438396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.438678 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.439010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.443146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.456667 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632016-0624-47a5-9aed-9866fd4890cd admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.461506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.462175 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.462852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.462852 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.463419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.465879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.505769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.507199 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.516254 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1376/2768] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:21.598456 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1393/2769] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:21 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:21.602571 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.610097 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=100 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:21.614496 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b00ce-e707-48a6-a95f-9ff656ea8085 service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.619153 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.620453 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.620745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.621019 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.621770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.623384 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.633361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1377/2770] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:21.637694 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.649036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf8e5-472e-4fd7-b401-415e4354cda0 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.653424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.654315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.654601 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.654877 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] PATH_INFO: `/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d/users/c92d6e27983d43dfaea43a32392b83a5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.671110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d2871a0a8c4afdb3c2777da72f604d, user_id=c92d6e27983d43dfaea43a32392b83a5, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.673805 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.754969 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1394/2771] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:21 2022] PUT /identity/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d/users/c92d6e27983d43dfaea43a32392b83a5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:21.763505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.769906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22482a8-3dc8-4dc3-9870-ac3385984b76 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.827463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.828141 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.828423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.828698 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.829424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.831022 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce92a-aacd-4e2f-9229-740f94399958 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.842119 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1378/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:21.846739 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:21.860947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5384-24b9-46d9-92fc-88be76f449e7 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:21.867597 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:21.868557 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.868836 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.869108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] PATH_INFO: `/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d/users/c92d6e27983d43dfaea43a32392b83a5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.871117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d2871a0a8c4afdb3c2777da72f604d, user_id=c92d6e27983d43dfaea43a32392b83a5, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:21.874001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:21.885204 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1395/2773] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:21 2022] PUT /identity/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d/users/c92d6e27983d43dfaea43a32392b83a5/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:21.896320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:21.896612 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:21.896894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:21.925631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] MFA Rules not processed for user `c92d6e27983d43dfaea43a32392b83a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:21.926840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:21.995427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1379/2774] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:22.070379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:22.127559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925b72c-f3bb-4347-8b1a-8679230f3a99 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:22.131310 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:22.132002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:22.132280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:22.132556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:22.191419 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:22.192906 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72ed16-c3ff-4236-805a-73ad7dea154f service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:22.202799 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1396/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:24.612130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:24.613639 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:24.681411 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841fe80-e6e0-45c5-9776-611e43948888 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:24.686692 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:24.687596 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:24.687906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:24.688186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] PATH_INFO: `/v3/users/b61c808beccc4586b41f6af3312743fd` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:24.689383 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61c808beccc4586b41f6af3312743fd)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:24.691294 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:24.708212 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:24.921035 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61c808beccc4586b41f6af3312743fd'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:24.921667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61c808beccc4586b41f6af3312743fd'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:24.933826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61c808beccc4586b41f6af3312743fd'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.069859 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61c808beccc4586b41f6af3312743fd'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.078749 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61c808beccc4586b41f6af3312743fd'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.084895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1380/2776] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:24 2022] DELETE /identity/v3/users/b61c808beccc4586b41f6af3312743fd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:25.089560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.094337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.094337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.109752 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:25.111026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.144394 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:25.176973 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1397/2777] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:25.187388 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:25.188948 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.249189 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed09-981f-460b-8297-ed412e9b2960 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:25.252936 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:25.255723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.255723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.255723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.264240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:25.265685 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ad55-bcdb-49df-82f3-7c7ddd01f2d5 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:25.275552 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1381/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:25.342454 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:25.345017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.358351 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f006e30-7a42-4ba9-aa69-697f0a3f0e02 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:25.363900 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:25.364787 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.365064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.365338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] PATH_INFO: `/v3/users/ce2b8b0dd2f84cc88c88738bc4a09c5e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.366551 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2b8b0dd2f84cc88c88738bc4a09c5e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:25.368539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:25.583506 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2b8b0dd2f84cc88c88738bc4a09c5e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.591312 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2b8b0dd2f84cc88c88738bc4a09c5e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.592070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2b8b0dd2f84cc88c88738bc4a09c5e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.605093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2b8b0dd2f84cc88c88738bc4a09c5e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.605889 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2b8b0dd2f84cc88c88738bc4a09c5e'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:25.677713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1398/2779] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:25 2022] DELETE /identity/v3/users/ce2b8b0dd2f84cc88c88738bc4a09c5e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:25.682535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.682535 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.683359 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.702949 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:25.706809 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.769086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1382/2780] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:25.780580 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:25.782180 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.786218 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:25.787938 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.797959 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55358-c893-4407-bec1-d0b0fb95f5e2 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:25.804831 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:25.805010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.805352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.805735 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] PATH_INFO: `/v3/projects/ca8606259f314e2bb9f04cd8c3fc7b5a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.806946 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8606259f314e2bb9f04cd8c3fc7b5a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:25.810321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:25.839750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:25.856765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ad5e-fdfe-4ec4-ac37-df7454011a5d None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:25.860718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:25.861589 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.861914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.862197 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.873129 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:25.885732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:25.885732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1383/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:25.885732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:25.886895 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:25.899533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98c1f-abfe-4ba8-b90f-800447523bad service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:25.904752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:25.905636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:25.906055 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:25.906407 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] PATH_INFO: `/v3/users/883fadeb67174161bd128a26473a98bf` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:25.907576 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=883fadeb67174161bd128a26473a98bf)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:25.909636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:25.952118 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8606259f314e2bb9f04cd8c3fc7b5a', 'request_id': 'req-c7d50a62-9d75-4483-96ef-e007eddcf2bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.091930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8606259f314e2bb9f04cd8c3fc7b5a', 'request_id': 'req-c7d50a62-9d75-4483-96ef-e007eddcf2bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.100823 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8606259f314e2bb9f04cd8c3fc7b5a', 'request_id': 'req-c7d50a62-9d75-4483-96ef-e007eddcf2bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.113062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] The token cache is being invalidate because project ca8606259f314e2bb9f04cd8c3fc7b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:26.113350 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.114039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c7d50a62-9d75-4483-96ef-e007eddcf2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.115609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1399/2782] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:25 2022] DELETE /identity/v3/projects/ca8606259f314e2bb9f04cd8c3fc7b5a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:26.241342 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883fadeb67174161bd128a26473a98bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.242490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883fadeb67174161bd128a26473a98bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.261130 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883fadeb67174161bd128a26473a98bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.369346 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883fadeb67174161bd128a26473a98bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.377726 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883fadeb67174161bd128a26473a98bf'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.383756 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1384/2783] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:25 2022] DELETE /identity/v3/users/883fadeb67174161bd128a26473a98bf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:26.388489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:26.388785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:26.389070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:26.406296 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:26.407711 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:26.409188 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:26.410548 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:26.445560 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:26.478090 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1400/2784] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:26.487110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c846b9-4d06-447b-aaff-60b886e09dbf admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:26.488693 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:26.490053 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:26.492098 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:26.493036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:26.493247 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:26.493779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] PATH_INFO: `/v3/projects/a7967ef63bc344bca017a5e411ee6ba8` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:26.495024 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7967ef63bc344bca017a5e411ee6ba8)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:26.497376 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:26.547862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fe289-31f6-4d96-981b-9a1cb302aec8 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:26.551497 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:26.552174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:26.552453 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:26.552726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:26.562254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:26.563688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:26.573636 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1401/2785] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:26.591944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7967ef63bc344bca017a5e411ee6ba8', 'request_id': 'req-9800acfd-a49e-45d5-97d5-995515fe9c96'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.595598 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:26.660994 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7967ef63bc344bca017a5e411ee6ba8', 'request_id': 'req-9800acfd-a49e-45d5-97d5-995515fe9c96'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.667913 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7967ef63bc344bca017a5e411ee6ba8', 'request_id': 'req-9800acfd-a49e-45d5-97d5-995515fe9c96'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.678487 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] The token cache is being invalidate because project a7967ef63bc344bca017a5e411ee6ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:26.678777 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.679423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.681053 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1385/2786] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:26 2022] DELETE /identity/v3/projects/a7967ef63bc344bca017a5e411ee6ba8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:26.685458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:26.695662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e461-c5fe-4367-8f23-32a0306b75c2 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:26.754913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:26.755794 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:26.756099 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:26.756367 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] PATH_INFO: `/v3/users/c92d6e27983d43dfaea43a32392b83a5` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:26.757581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92d6e27983d43dfaea43a32392b83a5)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:26.759584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:26.988499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92d6e27983d43dfaea43a32392b83a5'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.995483 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92d6e27983d43dfaea43a32392b83a5'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:26.996706 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92d6e27983d43dfaea43a32392b83a5'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.008682 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92d6e27983d43dfaea43a32392b83a5'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.009342 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92d6e27983d43dfaea43a32392b83a5'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.028965 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:27.030515 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:27.051740 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800acfd-a49e-45d5-97d5-995515fe9c96 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:27.057771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:27.059527 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:27.059825 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:27.060123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] PATH_INFO: `/v3/projects/4965b5675a4040bdae7932950542fd56` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:27.061387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4965b5675a4040bdae7932950542fd56)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:27.063362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:27.142105 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1402/2787] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:26 2022] DELETE /identity/v3/users/c92d6e27983d43dfaea43a32392b83a5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:27.222016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4965b5675a4040bdae7932950542fd56', 'request_id': 'req-01863432-2bc9-4a30-a70f-77bbd14423ca'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.317836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4965b5675a4040bdae7932950542fd56', 'request_id': 'req-01863432-2bc9-4a30-a70f-77bbd14423ca'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.326524 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4965b5675a4040bdae7932950542fd56', 'request_id': 'req-01863432-2bc9-4a30-a70f-77bbd14423ca'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.327392 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:27.337817 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] The token cache is being invalidate because project 4965b5675a4040bdae7932950542fd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:27.338106 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.338774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.340670 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1386/2788] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:27 2022] DELETE /identity/v3/projects/4965b5675a4040bdae7932950542fd56 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:27.344654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:27.346268 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:27.414773 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038510b7-42d2-40e1-9ba0-f3362ef7621e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:27.473045 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:27.473928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:27.474209 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:27.474486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] PATH_INFO: `/v3/users/2a95fe258b70472cafc9647e61e29f86` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:27.475692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a95fe258b70472cafc9647e61e29f86)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:27.477675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:27.562778 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:27.564312 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:27.582641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863432-2bc9-4a30-a70f-77bbd14423ca admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:27.590203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:27.590203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:27.590203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:27.590203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] PATH_INFO: `/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:27.591220 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d2871a0a8c4afdb3c2777da72f604d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:27.593182 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:27.675320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a95fe258b70472cafc9647e61e29f86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.682262 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a95fe258b70472cafc9647e61e29f86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.682927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a95fe258b70472cafc9647e61e29f86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.696788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a95fe258b70472cafc9647e61e29f86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.697450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-7ca6c5a3-a2d6-419c-953a-9d4468f140cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a95fe258b70472cafc9647e61e29f86'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.722159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d2871a0a8c4afdb3c2777da72f604d', 'request_id': 'req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.800731 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1403/2789] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:27 2022] DELETE /identity/v3/users/2a95fe258b70472cafc9647e61e29f86 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:27.878101 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d2871a0a8c4afdb3c2777da72f604d', 'request_id': 'req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.886641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d2871a0a8c4afdb3c2777da72f604d', 'request_id': 'req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.897942 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] The token cache is being invalidate because project f0d2871a0a8c4afdb3c2777da72f604d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:27.898238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.898900 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0f3a0b42-a6e3-4470-9e1f-2ee47d9cf31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:27.900521 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1387/2790] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:27 2022] DELETE /identity/v3/projects/f0d2871a0a8c4afdb3c2777da72f604d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:27.906278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:27.906569 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:27.906874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:27.927355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:27.928628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:27.945933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:27.992540 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1404/2791] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:28.000831 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.001135 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.001434 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.023027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:28.024331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.033362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1388/2792] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:28.042985 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.054634 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47757c-95c4-4a78-b1b1-81f5cf1ba0b5 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.061019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.061798 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.062109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.062386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.063227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:28.063538 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.065400 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.079393 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1405/2793] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:28.083255 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.093474 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f24d-9cd3-42d2-8361-6a11b1b744f7 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.098640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.099331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.099611 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.099915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.100762 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.102667 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.190696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1389/2794] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:28 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:28.194826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.205662 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5ef-702e-43bb-b3a3-e9734e1bec85 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.223554 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.227016 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.252770 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:28.271589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.272291 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.272575 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.272845 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.273556 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.275461 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.297446 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a0b2a-4c8d-44cc-bc09-ad7ec42e62ad admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.302185 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.303042 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.303330 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.303605 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] PATH_INFO: `/v3/projects/100ba276d9f24dc28872f50929f45458` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.304841 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ba276d9f24dc28872f50929f45458)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.306748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.366792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1406/2795] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:28 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:28.370827 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.381134 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636da62-4028-4881-830b-5918a6f72f73 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.385867 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.386514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.387486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.387948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.388950 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.390644 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.400897 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1407/2796] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:28.405376 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.415320 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18723b38-86a3-4ef0-8642-926a764de061 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.418645 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ba276d9f24dc28872f50929f45458', 'request_id': 'req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.473668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.474335 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.474616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.474892 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.475618 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.477254 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.486961 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1408/2797] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:28.491015 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.501043 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d276e-285a-4a92-8aae-3530aead62be admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.505711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93465084-313c-4011-9526-850a72f94365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.506574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465084-313c-4011-9526-850a72f94365 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.506855 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465084-313c-4011-9526-850a72f94365 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.507132 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465084-313c-4011-9526-850a72f94365 admin admin] PATH_INFO: `/v3/projects/383b640a6bac43c0b95fc64c6424105a/users/71204c0c3cc24d539537478f3c0bedc0/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.512802 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ba276d9f24dc28872f50929f45458', 'request_id': 'req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.519607 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ba276d9f24dc28872f50929f45458', 'request_id': 'req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.523903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93465084-313c-4011-9526-850a72f94365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383b640a6bac43c0b95fc64c6424105a, user_id=71204c0c3cc24d539537478f3c0bedc0, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.527619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93465084-313c-4011-9526-850a72f94365 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.531380 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] The token cache is being invalidate because project 100ba276d9f24dc28872f50929f45458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:28.531673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.532379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.533986 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1390/2798] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:28 2022] DELETE /identity/v3/projects/100ba276d9f24dc28872f50929f45458 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:28.537788 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.539249 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.552195 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd584a-91fb-47b1-9f94-4bf0070e1a4e admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.556829 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.557712 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.558256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.559123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] PATH_INFO: `/v3/users/eb8048afc4e94a058e27bc4a7ef6478d` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.560379 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8048afc4e94a058e27bc4a7ef6478d)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.562326 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.605583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:28.610659 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1409/2799] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:28 2022] PUT /identity/v3/projects/383b640a6bac43c0b95fc64c6424105a/users/71204c0c3cc24d539537478f3c0bedc0/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:28.620868 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.621637 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.622092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.649309 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] MFA Rules not processed for user `71204c0c3cc24d539537478f3c0bedc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:28.650578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.715270 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1410/2800] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:28.719919 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.721424 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.783610 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8048afc4e94a058e27bc4a7ef6478d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.784454 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8048afc4e94a058e27bc4a7ef6478d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.790319 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8919-7c61-45a4-91a9-56785ccd414f None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.796233 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:28.796863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:28.797149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:28.797427 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:28.798130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:28.798442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8048afc4e94a058e27bc4a7ef6478d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.800108 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:28.883375 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8048afc4e94a058e27bc4a7ef6478d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.890979 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1411/2801] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:28 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:28.891523 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8048afc4e94a058e27bc4a7ef6478d'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:28.895094 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:28.897029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:28.897957 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1391/2802] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:28 2022] DELETE /identity/v3/users/eb8048afc4e94a058e27bc4a7ef6478d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:28.966797 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559212c-5c73-4414-a554-86049058f2da admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:28.986570 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:29.026029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.026729 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.027019 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.027321 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.028162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.030117 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.122020 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1412/2803] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:28 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:29.123595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.134248 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d47f-8791-42c6-968f-38d9e59b008c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.142733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.142733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.142733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.142733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.143237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.144890 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.162357 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1392/2804] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:29.166070 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.180391 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97814ad-ae4c-4424-afa8-7de7ac4c6b5d admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.186136 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.186819 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.187218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.187685 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.188471 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.190185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.206109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1413/2805] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:29.290293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.302021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7bd9-cbfe-462d-8ae2-f8d9531aaa05 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.307157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.309013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.309483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.309796 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] PATH_INFO: `/v3/projects/1cf953c57ce24f81a8ad97970be740d5/users/bfefd0ae70414ca3b469582bec95e6d6/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.320084 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:29.327514 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf953c57ce24f81a8ad97970be740d5, user_id=bfefd0ae70414ca3b469582bec95e6d6, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.330272 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01d7d-caab-4e26-9053-0a468cede5d2 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.425474 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.429035 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:29.441777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ffbba-2bec-4e7a-9b23-2eb01e9cf3d8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.446890 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.447761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.448083 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.448359 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] PATH_INFO: `/v3/projects/07180a10bbb34952b85787ce0cb67db3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.449590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=07180a10bbb34952b85787ce0cb67db3)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.451616 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.454555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1393/2806] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:29 2022] PUT /identity/v3/projects/1cf953c57ce24f81a8ad97970be740d5/users/bfefd0ae70414ca3b469582bec95e6d6/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:29.467003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493a23-360a-4543-9041-729a62f1310e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.467293 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493a23-360a-4543-9041-729a62f1310e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.467649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493a23-360a-4543-9041-729a62f1310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.495116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-91493a23-360a-4543-9041-729a62f1310e None None] MFA Rules not processed for user `bfefd0ae70414ca3b469582bec95e6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:29.496445 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-91493a23-360a-4543-9041-729a62f1310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:29.556568 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07180a10bbb34952b85787ce0cb67db3', 'request_id': 'req-788f344e-2d1f-4d89-9dde-204da4e745aa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:29.574983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1394/2807] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:29.579771 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493a23-360a-4543-9041-729a62f1310e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.632463 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07180a10bbb34952b85787ce0cb67db3', 'request_id': 'req-788f344e-2d1f-4d89-9dde-204da4e745aa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:29.641564 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07180a10bbb34952b85787ce0cb67db3', 'request_id': 'req-788f344e-2d1f-4d89-9dde-204da4e745aa'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:29.643036 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493a23-360a-4543-9041-729a62f1310e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.659624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] The token cache is being invalidate because project 07180a10bbb34952b85787ce0cb67db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:29.659962 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:29.660652 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-788f344e-2d1f-4d89-9dde-204da4e745aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:29.662353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1414/2808] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:29 2022] DELETE /identity/v3/projects/07180a10bbb34952b85787ce0cb67db3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:29.668315 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fadc-9917-4099-a1f7-369b06b36c96 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.668887 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fadc-9917-4099-a1f7-369b06b36c96 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.669304 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fadc-9917-4099-a1f7-369b06b36c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.688826 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-fe11fadc-9917-4099-a1f7-369b06b36c96 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:29.690109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-fe11fadc-9917-4099-a1f7-369b06b36c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:29.703935 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.704604 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.704946 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.705210 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.705876 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.707786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.758956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1415/2809] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:29.767980 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.768464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.768584 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.787159 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:29.788381 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:29.796581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1416/2810] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:29.800014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1395/2811] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:29.801215 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.804041 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.806349 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:29.811343 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6fb0-6ec7-4d03-bf38-482cda367579 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.817889 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:29.823490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:29.869835 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.870600 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.870917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.871486 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.872252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:29.872559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.873635 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b8a5-d270-4ae9-afee-e1c0630e5b57 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.874169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.879513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.880367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.880658 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.880944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.881662 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.883586 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.885917 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1417/2812] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:02:29.891574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.901632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6074a-db81-4ef7-9af1-209b479a548e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.906905 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.907546 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.907854 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.908154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.908863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.910748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:29.967201 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1396/2813] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:29.971406 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:29.982714 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dffc-b290-430a-8b95-921e49e144d1 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:29.988988 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:29.995100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:29.995100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:29.995100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:29.995100 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:29.995517 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1418/2814] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:29.995624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.001074 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.006196 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1397/2815] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:30.010609 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.022720 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1974ba-d452-4a4b-8995-1d869b38a862 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.081978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ca23-9501-4347-a846-c75627333e2f admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.086910 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.087585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.087894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.088169 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.088858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.089504 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.091167 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.091412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.091551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.091931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] PATH_INFO: `/v3/projects/bfca3a14a19a451d877776310475d0f8/users/7fc40bd361fe41eda0c64ed25be4e40c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.110147 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca3a14a19a451d877776310475d0f8, user_id=7fc40bd361fe41eda0c64ed25be4e40c, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.112836 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.194833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1419/2816] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:29 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:30.198879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.209491 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ead2-6226-4ee9-8774-8bd6c1ebd4c4 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.212162 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1398/2817] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:30 2022] PUT /identity/v3/projects/bfca3a14a19a451d877776310475d0f8/users/7fc40bd361fe41eda0c64ed25be4e40c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:30.218018 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.270002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.270676 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.270958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.271229 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.272022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.273624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.282455 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186fdbb-310a-4d6a-bb87-468c4438a653 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.287141 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1420/2818] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:30.288249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.290546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.292969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.292969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.292969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.292969 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.295397 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.298948 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5fe4-bad5-4683-b32b-b28d9761a636 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.303642 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.304369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.304653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.304930 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.305658 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.306025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1399/2819] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:30.307251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.310696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.319341 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1421/2820] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:30.320784 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932198-d86d-460e-b5ec-e339fde7fce9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.323583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.326134 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.327017 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.327305 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.327583 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] PATH_INFO: `/v3/projects/bfca3a14a19a451d877776310475d0f8/users/7fc40bd361fe41eda0c64ed25be4e40c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.329650 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca3a14a19a451d877776310475d0f8, user_id=7fc40bd361fe41eda0c64ed25be4e40c, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.331308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:30.332322 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2aa9d-c7bf-492c-a2a4-c5a8fea12362 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.334681 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:30.336426 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408785a-29e2-4d55-b506-80d84e183916 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.344457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.345939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.346395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.346846 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] PATH_INFO: `/v3/projects/5735aaeedb6346188401cc5fcb51c030/users/a2e99d8e9ac043f288fe1edc62d4cca3/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.349062 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1400/2821] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:30 2022] PUT /identity/v3/projects/bfca3a14a19a451d877776310475d0f8/users/7fc40bd361fe41eda0c64ed25be4e40c/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:30.359951 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a4fa-e7dc-4cf5-9650-a73f4a5d5740 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.360238 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a4fa-e7dc-4cf5-9650-a73f4a5d5740 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.360513 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a4fa-e7dc-4cf5-9650-a73f4a5d5740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.364281 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5735aaeedb6346188401cc5fcb51c030, user_id=a2e99d8e9ac043f288fe1edc62d4cca3, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.366884 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.387943 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-1871a4fa-e7dc-4cf5-9650-a73f4a5d5740 None None] MFA Rules not processed for user `7fc40bd361fe41eda0c64ed25be4e40c`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:30.389186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-1871a4fa-e7dc-4cf5-9650-a73f4a5d5740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:30.458028 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1422/2822] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:30 2022] PUT /identity/v3/projects/5735aaeedb6346188401cc5fcb51c030/users/a2e99d8e9ac043f288fe1edc62d4cca3/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:30.461883 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1401/2823] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:30.475129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.475129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:30.525155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.525451 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.525725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.538974 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa15ce-6fb4-4737-9b84-d31e88a811da admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.542716 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.543624 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.543932 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.544218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.546135 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:30.552709 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] MFA Rules not processed for user `a2e99d8e9ac043f288fe1edc62d4cca3`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:30.553921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:30.608475 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.609927 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.619146 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1423/2824] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:30.623595 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1402/2825] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:30.628253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.691893 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2776bc-5f03-4cb1-8330-bd2a0be5964f service cinder] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.696559 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.697211 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.697490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.697757 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.698460 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.701026 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.799418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1424/2826] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:30 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:30.803314 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.815669 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6111c9-06d6-4487-a85a-475d43276456 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.874849 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.875522 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.875826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.876123 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.876830 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.878759 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:30.964070 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:30.970173 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1403/2827] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:30 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:30.974296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:30.985339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f5eb2-5894-410b-93a1-549c431ba790 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:30.990050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:30.990774 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:30.991061 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:30.991340 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:30.992113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:30.993768 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:31.006914 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1425/2828] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:31.011163 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:31.023482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0966-2d97-4cb9-a94f-8a1929a134ac admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:31.028881 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:31.029799 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:31.030085 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:31.030362 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] PATH_INFO: `/v3/projects/02c56eef6e9240519c96955ae5d6559e/users/9710c09d8db64afeb3575622d8ff8c00/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:31.046465 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c56eef6e9240519c96955ae5d6559e, user_id=9710c09d8db64afeb3575622d8ff8c00, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:31.049168 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:31.160832 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1404/2829] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:31 2022] PUT /identity/v3/projects/02c56eef6e9240519c96955ae5d6559e/users/9710c09d8db64afeb3575622d8ff8c00/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:31.164880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:31.175784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb47e7a-3791-4fb5-9b86-8da73259baf8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:31.180363 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:31.233159 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:31.233863 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:31.234149 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:31.234429 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:31.235157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:31.236913 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c86b01-f526-4737-9a93-f0e86fe41386 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:31.250711 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1426/2830] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:31.252150 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:31.262945 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77ac4-8a95-4280-a05c-37280f07b6e5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:31.267651 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:31.268575 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:31.268862 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:31.269233 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] PATH_INFO: `/v3/projects/02c56eef6e9240519c96955ae5d6559e/users/9710c09d8db64afeb3575622d8ff8c00/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:31.271241 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c56eef6e9240519c96955ae5d6559e, user_id=9710c09d8db64afeb3575622d8ff8c00, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:31.273910 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:31.287944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1405/2831] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:31 2022] PUT /identity/v3/projects/02c56eef6e9240519c96955ae5d6559e/users/9710c09d8db64afeb3575622d8ff8c00/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:31.295837 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:31.296137 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:31.296415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:31.326252 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] MFA Rules not processed for user `9710c09d8db64afeb3575622d8ff8c00`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:31.327448 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:31.398513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1427/2832] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:31.411208 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:31.471467 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1001-9eaf-43ec-8b61-dd7feb74c532 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:31.475378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:31.476090 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:31.488902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:31.488902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:31.488902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:31.488902 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7c430-ec31-48dd-84b3-8be6ceaa42ed service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:31.498800 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1406/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:32.013692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:32.077862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2f847-1e68-45d7-95a4-d6bb03568ceb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:32.082615 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:32.083487 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:32.083765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:32.084064 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] PATH_INFO: `/v3/users/a2e99d8e9ac043f288fe1edc62d4cca3` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:32.085253 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e99d8e9ac043f288fe1edc62d4cca3)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:32.087219 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:32.262567 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:32.274926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e99d8e9ac043f288fe1edc62d4cca3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:32.282947 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e99d8e9ac043f288fe1edc62d4cca3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:32.283688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e99d8e9ac043f288fe1edc62d4cca3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:32.297308 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e99d8e9ac043f288fe1edc62d4cca3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:32.297972 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e99d8e9ac043f288fe1edc62d4cca3'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:32.372528 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1428/2834] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:32 2022] DELETE /identity/v3/users/a2e99d8e9ac043f288fe1edc62d4cca3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:32.377501 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:32.377973 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:32.378286 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:32.400338 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:32.401701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:32.467372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1407/2835] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:32.477296 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:32.478915 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:32.538542 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c7f2-5e82-45a1-b984-f5dfc2255243 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:32.542565 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:32.543227 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:32.543513 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:32.543788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:32.554627 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:32.556106 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:32.567858 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1429/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:32.646743 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:32.648257 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:32.708332 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51e074-6405-43cd-b4fe-dfdd77d4f17e None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:32.711971 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:32.712618 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:32.712897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:32.713203 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:32.714944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:32.734790 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:32.779213 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:32.780813 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:32.791904 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1408/2837] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:32.991880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:32.991880 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:33.005354 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4833ce-c56f-4372-8837-14eb6967cc85 service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:33.010373 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:33.011246 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:33.011539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:33.011838 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] PATH_INFO: `/v3/projects/5735aaeedb6346188401cc5fcb51c030` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:33.013086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5735aaeedb6346188401cc5fcb51c030)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:33.015588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:33.200418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5735aaeedb6346188401cc5fcb51c030', 'request_id': 'req-163269a5-1551-402a-9bf4-3d8cf8f7fb09'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.268857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5735aaeedb6346188401cc5fcb51c030', 'request_id': 'req-163269a5-1551-402a-9bf4-3d8cf8f7fb09'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.275874 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5735aaeedb6346188401cc5fcb51c030', 'request_id': 'req-163269a5-1551-402a-9bf4-3d8cf8f7fb09'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.287912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] The token cache is being invalidate because project 5735aaeedb6346188401cc5fcb51c030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:33.292761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.292761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.292761 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1430/2838] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:32 2022] DELETE /identity/v3/projects/5735aaeedb6346188401cc5fcb51c030 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:33.294959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:33.305792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b61-ba69-4d66-ac47-b36e12ea917e service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:33.370450 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:33.371402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:33.371708 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:33.372010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] PATH_INFO: `/v3/users/9710c09d8db64afeb3575622d8ff8c00` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:33.373840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9710c09d8db64afeb3575622d8ff8c00)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:33.375786 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:33.540112 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9710c09d8db64afeb3575622d8ff8c00'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.540826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9710c09d8db64afeb3575622d8ff8c00'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.554155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9710c09d8db64afeb3575622d8ff8c00'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.680640 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9710c09d8db64afeb3575622d8ff8c00'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.688737 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9710c09d8db64afeb3575622d8ff8c00'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:33.694827 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1409/2839] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:33 2022] DELETE /identity/v3/users/9710c09d8db64afeb3575622d8ff8c00 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:34.099958 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.101688 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:34.118165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a5-1551-402a-9bf4-3d8cf8f7fb09 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.154641 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:34.180596 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.181500 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.181784 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.182063 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] PATH_INFO: `/v3/projects/02c56eef6e9240519c96955ae5d6559e` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.183563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c56eef6e9240519c96955ae5d6559e)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.186030 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.299276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c56eef6e9240519c96955ae5d6559e', 'request_id': 'req-c427883e-5cc3-46bb-af4a-ecd515ef6b37'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:34.383174 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c56eef6e9240519c96955ae5d6559e', 'request_id': 'req-c427883e-5cc3-46bb-af4a-ecd515ef6b37'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:34.390595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c56eef6e9240519c96955ae5d6559e', 'request_id': 'req-c427883e-5cc3-46bb-af4a-ecd515ef6b37'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:34.400423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.401664 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] The token cache is being invalidate because project 02c56eef6e9240519c96955ae5d6559e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:34.401953 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:34.402068 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:34.402609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-c427883e-5cc3-46bb-af4a-ecd515ef6b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:34.404937 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1431/2840] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:34 2022] DELETE /identity/v3/projects/02c56eef6e9240519c96955ae5d6559e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:34.409581 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdd53-c3a0-4f51-a43b-485c07cec6d2 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.409873 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdd53-c3a0-4f51-a43b-485c07cec6d2 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.410153 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdd53-c3a0-4f51-a43b-485c07cec6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.429743 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e70bdd53-c3a0-4f51-a43b-485c07cec6d2 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:34.431017 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e70bdd53-c3a0-4f51-a43b-485c07cec6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:34.448993 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:34.464219 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8c69-f36b-4a44-b81f-e2696b06d9d9 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.495371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1432/2841] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:34.503840 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.504139 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.504425 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.518741 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.519401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.519687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.520003 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.521821 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:34.524257 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:34.525439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:34.534545 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1433/2842] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:34.538423 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.548110 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5937754-d9cc-4faf-8108-c9705ce32fbf None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.553029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.553689 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.553970 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.554245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.555005 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:34.555438 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.557158 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.570432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1434/2843] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:34.574715 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.585187 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fe3d6-a6f9-4dfe-a22b-5479e5324032 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.589933 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.590512 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.590649 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.591093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.591093 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.592613 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.592748 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.594529 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.603071 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1410/2844] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:02:34.722314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1435/2845] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:34 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:34.731011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.741959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5364c9-89a9-4476-996f-a81edc3d1cdf service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.802980 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.803657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.803979 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.804256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.804958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.806923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.897826 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1411/2846] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:34 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:34.901982 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.912336 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f86e2-5c38-4efa-b026-b43779b7d45e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.917883 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.923368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.923368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.923368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.923368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.923368 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.932208 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1436/2847] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:34.938735 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.948840 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715d024-7d62-44a5-b770-e09cc651affb admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.953745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.954442 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.954723 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.954999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:34.955745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:34.957463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a82ee5-3a10-4e82-a154-b88d9977d5f0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:34.968499 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1412/2848] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:34.972931 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:34.984588 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecba64c-75c3-4e5d-97c1-acd7251a0ef6 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:34.989412 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:34.990306 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:34.990589 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:34.990869 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] PATH_INFO: `/v3/projects/f9e3fc15d81b47c8b76e89b8bf039930/users/04440b9a6a4b44b48f39cd27a124cd76/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.005203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:35.009599 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e3fc15d81b47c8b76e89b8bf039930, user_id=04440b9a6a4b44b48f39cd27a124cd76, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.012379 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.137398 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1437/2849] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:34 2022] PUT /identity/v3/projects/f9e3fc15d81b47c8b76e89b8bf039930/users/04440b9a6a4b44b48f39cd27a124cd76/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:35.151025 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.151260 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.151539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.180899 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] MFA Rules not processed for user `04440b9a6a4b44b48f39cd27a124cd76`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:35.182124 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:35.193198 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:35.251733 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1413/2850] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:35.256286 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.320337 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2ebb-f82f-4e2f-9516-a4562d212d46 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.325001 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.327464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.327464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.327464 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.327777 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.329593 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.418956 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1438/2851] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:35.424291 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.437030 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e292c-f08d-459d-a9ec-30f4c3ddf394 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.502026 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.502706 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.503013 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.503278 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.504011 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.505981 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.589940 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1414/2852] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:35 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:35.594862 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.605692 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024677c-f616-4c6f-96d1-26233bdc6059 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.610590 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.611241 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.611515 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.611912 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.612691 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.614256 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.629473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1439/2853] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:35.630894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.642687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65defcd1-38f7-4542-ad29-a81707d0ae3c admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.647424 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.648344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.648631 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.648909 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] PATH_INFO: `/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab/users/bd0a90ca074b49918de919f17c699acc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.664473 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e408543eeaf94ee8adcbbaf2caa021ab, user_id=bd0a90ca074b49918de919f17c699acc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.667110 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.753696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1415/2854] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:35 2022] PUT /identity/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab/users/bd0a90ca074b49918de919f17c699acc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:02:35.757714 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.768029 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935beb2a-03bc-41fb-975a-50c21de60244 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.823882 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.824543 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.824822 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.825092 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.825993 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.827726 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01f7f-6124-4f37-b528-3f46e57c84b2 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.838031 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1440/2855] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 15:02:35.842879 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:35.854075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadea9f-b94c-482d-a1c5-f9f628520791 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:35.859387 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:35.860394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.860687 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.860963 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] PATH_INFO: `/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab/users/bd0a90ca074b49918de919f17c699acc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.863021 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e408543eeaf94ee8adcbbaf2caa021ab, user_id=bd0a90ca074b49918de919f17c699acc, role_id=a897d8f9c9c2436fba6b0c44a5f6bb07)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:35.865701 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:35.879636 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1416/2856] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:35 2022] PUT /identity/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab/users/bd0a90ca074b49918de919f17c699acc/roles/a897d8f9c9c2436fba6b0c44a5f6bb07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:35.890366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:35.890661 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:35.890944 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:35.919203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] MFA Rules not processed for user `bd0a90ca074b49918de919f17c699acc`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:35.921332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:35.972758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:35.995648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1441/2857] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 15:02:36.007999 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:36.009897 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:36.073657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc4681-59f8-4d91-9d86-0fc460a400da admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:36.078159 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:36.078824 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:36.079116 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:36.079396 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:36.089065 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:36.090519 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:36.101448 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1417/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:36.229366 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:36.241047 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe0e32-e8cb-4f95-b50f-1f54d519ae58 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:36.245054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:36.245942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:36.246238 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:36.246582 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:36.312574 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:36.314039 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a759e-1eb6-4ade-875d-bc5acf2a118e service cinder] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:36.323346 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1442/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:36.769808 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:36.778629 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:36.834059 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2673-2434-42ef-a39a-d87b3b552cda service cinder] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:36.839092 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:36.840005 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:36.840287 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:36.840557 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] PATH_INFO: `/v3/users/04440b9a6a4b44b48f39cd27a124cd76` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:36.842414 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04440b9a6a4b44b48f39cd27a124cd76)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:36.846488 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:37.038426 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04440b9a6a4b44b48f39cd27a124cd76'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:37.039015 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04440b9a6a4b44b48f39cd27a124cd76'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:37.053422 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04440b9a6a4b44b48f39cd27a124cd76'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:37.165871 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04440b9a6a4b44b48f39cd27a124cd76'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:37.176719 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04440b9a6a4b44b48f39cd27a124cd76'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:37.184803 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1418/2860] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:36 2022] DELETE /identity/v3/users/04440b9a6a4b44b48f39cd27a124cd76 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:37.190764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:37.191054 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:37.191387 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:37.213765 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:37.214998 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:37.285052 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1443/2861] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:37.295653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:37.297307 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:37.376755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18aea-92d8-4cfb-9082-2119f9db5cf5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:37.380540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:37.381202 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:37.381490 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:37.381769 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:37.392277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:37.397115 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:37.403894 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1419/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:37.848292 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:37.854128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:37.869978 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0a7c-f90b-4f89-bc4f-3532a2abdd2c None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:37.876864 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:37.877760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:37.878813 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:37.879104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] PATH_INFO: `/v3/projects/f9e3fc15d81b47c8b76e89b8bf039930` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:37.880459 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e3fc15d81b47c8b76e89b8bf039930)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:37.882609 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:38.023050 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e3fc15d81b47c8b76e89b8bf039930', 'request_id': 'req-2954bc91-1b86-4a79-a2a9-83ae17677252'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.089646 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e3fc15d81b47c8b76e89b8bf039930', 'request_id': 'req-2954bc91-1b86-4a79-a2a9-83ae17677252'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.097723 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e3fc15d81b47c8b76e89b8bf039930', 'request_id': 'req-2954bc91-1b86-4a79-a2a9-83ae17677252'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.109572 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] The token cache is being invalidate because project f9e3fc15d81b47c8b76e89b8bf039930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:38.110022 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.110792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.112563 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1444/2863] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:37 2022] DELETE /identity/v3/projects/f9e3fc15d81b47c8b76e89b8bf039930 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:38.117027 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:38.131323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d570-9669-43b9-915c-4641f3c4af06 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:38.159340 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:38.191885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:38.192772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:38.193060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:38.193348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] PATH_INFO: `/v3/users/bd0a90ca074b49918de919f17c699acc` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:38.195107 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0a90ca074b49918de919f17c699acc)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:38.197546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:38.432755 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0a90ca074b49918de919f17c699acc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.433908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0a90ca074b49918de919f17c699acc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.447216 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0a90ca074b49918de919f17c699acc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.501237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0a90ca074b49918de919f17c699acc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.508923 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0a90ca074b49918de919f17c699acc'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:38.515792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1420/2864] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:38 2022] DELETE /identity/v3/users/bd0a90ca074b49918de919f17c699acc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:38.964111 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:38.965668 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:38.982014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bc91-1b86-4a79-a2a9-83ae17677252 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:38.986353 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:39.049788 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:39.050698 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:39.051280 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:39.051745 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] PATH_INFO: `/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:39.053338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e408543eeaf94ee8adcbbaf2caa021ab)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:39.055339 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:39.159203 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e408543eeaf94ee8adcbbaf2caa021ab', 'request_id': 'req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.226635 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e408543eeaf94ee8adcbbaf2caa021ab', 'request_id': 'req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.234128 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e408543eeaf94ee8adcbbaf2caa021ab', 'request_id': 'req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.245057 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] The token cache is being invalidate because project e408543eeaf94ee8adcbbaf2caa021ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:39.245345 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.246008 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-dfe2be49-c7ae-40b9-9f02-cb34d2d7ce5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.248264 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1445/2865] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:38 2022] DELETE /identity/v3/projects/e408543eeaf94ee8adcbbaf2caa021ab => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:39.420012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:39.421580 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:39.435377 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147da6d-9c78-45b9-87bd-62032c111332 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:39.496828 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:39.498914 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:39.499206 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:39.499477 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] PATH_INFO: `/v3/users/71204c0c3cc24d539537478f3c0bedc0` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:39.500798 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71204c0c3cc24d539537478f3c0bedc0)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:39.502732 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:39.744966 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71204c0c3cc24d539537478f3c0bedc0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.745617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71204c0c3cc24d539537478f3c0bedc0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.747546 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:39.758427 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71204c0c3cc24d539537478f3c0bedc0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.820628 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71204c0c3cc24d539537478f3c0bedc0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.829372 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71204c0c3cc24d539537478f3c0bedc0'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:39.835622 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1421/2866] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:39 2022] DELETE /identity/v3/users/71204c0c3cc24d539537478f3c0bedc0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:39.840362 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:39.840654 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:39.840940 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:39.858764 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:39.860014 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:39.919656 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1446/2867] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:39.929548 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:39.930983 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:39.989713 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb195-85ea-4577-bef7-2968e0e24853 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:39.993410 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:39.994023 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:39.994308 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:39.994585 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:40.005149 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:40.006246 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:40.015944 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1422/2868] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:40.491251 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:40.492771 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:40.507719 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8f9b9-0ba7-49b6-a31f-ae027bcdb8db None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:40.513086 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:40.514079 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:40.514369 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:40.514666 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] PATH_INFO: `/v3/projects/383b640a6bac43c0b95fc64c6424105a` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:40.517163 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383b640a6bac43c0b95fc64c6424105a)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:40.519162 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:40.620995 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:40.636012 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383b640a6bac43c0b95fc64c6424105a', 'request_id': 'req-6880853b-180d-4cae-9f8b-ece505136d54'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.697322 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383b640a6bac43c0b95fc64c6424105a', 'request_id': 'req-6880853b-180d-4cae-9f8b-ece505136d54'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.705578 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383b640a6bac43c0b95fc64c6424105a', 'request_id': 'req-6880853b-180d-4cae-9f8b-ece505136d54'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.716782 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] The token cache is being invalidate because project 383b640a6bac43c0b95fc64c6424105a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:40.717067 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.717713 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.719783 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1447/2869] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:40 2022] DELETE /identity/v3/projects/383b640a6bac43c0b95fc64c6424105a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:40.723772 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:40.739959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d470c-5e3d-4037-abf6-850e6612a7b5 service neutron] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:40.798931 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:40.799721 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:40.800033 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:40.800310 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] PATH_INFO: `/v3/users/bfefd0ae70414ca3b469582bec95e6d6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:40.801532 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfefd0ae70414ca3b469582bec95e6d6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:40.803468 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:40.969718 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfefd0ae70414ca3b469582bec95e6d6'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.970394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfefd0ae70414ca3b469582bec95e6d6'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:40.982752 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfefd0ae70414ca3b469582bec95e6d6'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.064482 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfefd0ae70414ca3b469582bec95e6d6'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.065933 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:41.072885 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfefd0ae70414ca3b469582bec95e6d6'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.080781 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1423/2870] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:40 2022] DELETE /identity/v3/users/bfefd0ae70414ca3b469582bec95e6d6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:41.533736 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:41.535355 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:41.550430 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880853b-180d-4cae-9f8b-ece505136d54 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:41.612002 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:41.612885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:41.613164 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:41.613437 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] PATH_INFO: `/v3/projects/1cf953c57ce24f81a8ad97970be740d5` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:41.614660 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf953c57ce24f81a8ad97970be740d5)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:41.616630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:41.724806 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf953c57ce24f81a8ad97970be740d5', 'request_id': 'req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.797903 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf953c57ce24f81a8ad97970be740d5', 'request_id': 'req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.805279 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf953c57ce24f81a8ad97970be740d5', 'request_id': 'req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.817127 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] The token cache is being invalidate because project 1cf953c57ce24f81a8ad97970be740d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:41.817417 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.818036 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:41.819669 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1448/2871] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:41 2022] DELETE /identity/v3/projects/1cf953c57ce24f81a8ad97970be740d5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:41.823958 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:41.825463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:41.839256 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14fdb-a2fb-4258-96d9-3d6481140453 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:41.899157 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:41.899991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:41.900277 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:41.900555 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] PATH_INFO: `/v3/users/7fc40bd361fe41eda0c64ed25be4e40c` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:41.901746 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc40bd361fe41eda0c64ed25be4e40c)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:41.903657 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:42.149484 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc40bd361fe41eda0c64ed25be4e40c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.150038 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc40bd361fe41eda0c64ed25be4e40c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.162597 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc40bd361fe41eda0c64ed25be4e40c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.226347 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc40bd361fe41eda0c64ed25be4e40c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.233738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-8331242f-a2c5-4fc7-9fa5-f4df9e34d400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc40bd361fe41eda0c64ed25be4e40c'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.239765 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1424/2872] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:02:41 2022] DELETE /identity/v3/users/7fc40bd361fe41eda0c64ed25be4e40c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:42.668084 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:42.669622 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:42.682607 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dc359-23c4-4abc-aba3-cae3d04c6dce admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:42.732566 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:42.742576 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:42.743442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:42.743728 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:42.744032 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] PATH_INFO: `/v3/projects/bfca3a14a19a451d877776310475d0f8` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:42.745255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfca3a14a19a451d877776310475d0f8)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:42.747160 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:42.861444 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfca3a14a19a451d877776310475d0f8', 'request_id': 'req-58b315e2-2cc1-48ca-a59d-b86009c2369a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.929386 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfca3a14a19a451d877776310475d0f8', 'request_id': 'req-58b315e2-2cc1-48ca-a59d-b86009c2369a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.936655 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfca3a14a19a451d877776310475d0f8', 'request_id': 'req-58b315e2-2cc1-48ca-a59d-b86009c2369a'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.949939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] The token cache is being invalidate because project bfca3a14a19a451d877776310475d0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:02:42.949939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.949939 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-58b315e2-2cc1-48ca-a59d-b86009c2369a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:02:42.950999 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1449/2873] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:02:42 2022] DELETE /identity/v3/projects/bfca3a14a19a451d877776310475d0f8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:42.956864 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:42.957409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:42.957409 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:42.975915 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:42.977133 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:43.040608 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1425/2874] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:43.104647 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.104942 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.105185 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.125374 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:43.126595 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:43.134562 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1450/2875] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:43.139029 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.148941 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560bc3-dac5-470a-bc82-d03e6773e827 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.153471 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.154146 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.154423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.154696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] PATH_INFO: `/v3/domains` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.155421 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87016) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:02:43.155754 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.157367 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.159908 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:43.169509 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1426/2876] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 15:02:43.174994 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.184740 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6e5d-68cd-4b6d-84d2-9dc3f8a60feb None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.190403 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.191062 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.191338 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.191610 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] PATH_INFO: `/v3/projects` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.192418 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.194247 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.287046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1451/2877] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:02:43 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:02:43.291186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.302175 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809b045-2fbd-4931-aabf-bf865560841b admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.361401 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.362064 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.362344 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.362617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.363348 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.365435 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.473111 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1427/2878] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:02:43 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 15:02:43.477130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.487648 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7ee4-de61-40ac-b402-c96ac3f8690e admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.492255 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.504214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.504214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.504214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.504214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.504214 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.507705 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1452/2879] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:43.511734 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.522776 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116e9e-6374-46c1-b084-dbd1a39951d0 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.527475 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.528172 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.528458 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.528736 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.529466 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.531345 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ea26e-aeb6-49d8-bdb2-79f6af74747d admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.541574 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1428/2880] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:02:43.545732 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.556013 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015c93-48e2-4690-92c5-0d05f45aed63 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.561010 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.562395 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.562675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.562952 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] PATH_INFO: `/v3/projects/cb2b278ee40348b981b4ccca3a241e62/users/83bc477c6b974b5caf3b94c44a7896bb/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.578809 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2b278ee40348b981b4ccca3a241e62, user_id=83bc477c6b974b5caf3b94c44a7896bb, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.581499 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.663046 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1453/2881] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:02:43 2022] PUT /identity/v3/projects/cb2b278ee40348b981b4ccca3a241e62/users/83bc477c6b974b5caf3b94c44a7896bb/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:02:43.674075 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.674369 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.674682 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.702898 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] MFA Rules not processed for user `83bc477c6b974b5caf3b94c44a7896bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:02:43.704505 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:43.770590 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1429/2882] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:02:43.782539 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:43.784318 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:43.842432 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9ee10-afb5-4b39-92ab-7fc04bd3cd5a admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:43.846833 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '150269945dcc49b0ac4f074e88312177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:43.847490 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:43.847767 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:43.848072 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:43.856888 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:43.858332 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:43.867314 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1454/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:50.286887 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:02:50.288483 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:50.369675 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94735-63e1-4020-bf58-07f48b71fd27 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:02:50.374921 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:02:50.375738 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:02:50.376052 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:02:50.376334 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:02:50.378186 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:02:50.387351 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:50.392281 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:02:50.393918 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7d08-8c78-4a08-93ff-7b654b6dfd68 service placement] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:02:50.406779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1430/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:02:53.863439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:00.449000 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:07.224131 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:07.288091 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883af9b8-2923-4dab-b80b-42fe3d68f780 service glance] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:07.292619 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:07.293489 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:07.293772 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:07.294049 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] PATH_INFO: `/v3/users/83bc477c6b974b5caf3b94c44a7896bb` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:07.295245 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bc477c6b974b5caf3b94c44a7896bb)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:07.297218 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:07.503442 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bc477c6b974b5caf3b94c44a7896bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:07.510409 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bc477c6b974b5caf3b94c44a7896bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:07.511130 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bc477c6b974b5caf3b94c44a7896bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:07.524457 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bc477c6b974b5caf3b94c44a7896bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:07.527879 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bc477c6b974b5caf3b94c44a7896bb'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:07.591894 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1455/2885] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:03:07 2022] DELETE /identity/v3/users/83bc477c6b974b5caf3b94c44a7896bb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:03:07.596696 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:07.597268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:07.597268 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:07.615472 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:03:07.616745 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:07.678664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1431/2886] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:03:07.689382 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:07.690792 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:07.754223 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ef6d8-8842-462d-b4d0-57417d7575a1 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:07.757929 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:07.758585 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:07.758898 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:07.759170 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:07.768469 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:07.769928 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ab41f-7c7f-4052-b2b3-2a80f8080df1 service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:07.779352 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1456/2887] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:03:08.173020 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.174551 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:08.187010 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46db68-18a8-4fb3-8f5d-d03c7b0a6bc3 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.192545 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.193641 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.194095 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.194382 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] PATH_INFO: `/v3/projects/cb2b278ee40348b981b4ccca3a241e62` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.196533 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2b278ee40348b981b4ccca3a241e62)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.198664 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.302323 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2b278ee40348b981b4ccca3a241e62', 'request_id': 'req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:08.393977 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2b278ee40348b981b4ccca3a241e62', 'request_id': 'req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:08.400805 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2b278ee40348b981b4ccca3a241e62', 'request_id': 'req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:08.411953 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] The token cache is being invalidate because project cb2b278ee40348b981b4ccca3a241e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:03:08.412237 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:08.412874 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-4b53c49b-ee2e-4cd9-afaf-da984d2e132f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:08.414423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1432/2888] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:03:08 2022] DELETE /identity/v3/projects/cb2b278ee40348b981b4ccca3a241e62 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:03:08.419276 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.419875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.419875 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.438885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:03:08.440121 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:08.458004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:08.501129 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1457/2889] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:03:08.508774 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.509073 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.509361 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.528423 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:03:08.529648 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:08.538378 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1433/2890] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:03:08.542632 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.552700 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb74a2-8e20-414b-8b22-a3903d46c0fe None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.557258 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.558220 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.558507 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.558785 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.559522 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 15:03:08.559861 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.561480 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.573157 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1458/2891] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jun 15 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 15:03:08.577540 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.587865 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa51a-10da-4e58-9269-a27c511f5b56 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.592567 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.593223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.593510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.593792 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.595228 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.597299 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.685320 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1434/2892] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jun 15 15:03:08 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:03:08.689628 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.699911 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5460d-6859-4d56-87a6-c7eb732115f8 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.762708 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.763385 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.763665 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.764113 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] PATH_INFO: `/v3/users` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.764817 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.767278 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.855109 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1459/2893] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jun 15 15:03:08 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 15:03:08.859481 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.870066 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe222-14f6-4993-8911-3ebf894a7aeb admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.874750 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.875457 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.876394 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.876674 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.877402 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.878998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.889653 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1435/2894] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:03:08.894857 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.905100 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1589-43e9-48b1-a2de-82f6ca695254 admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.910154 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.910820 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.911107 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.911389 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.912197 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.913807 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce331a3-f4b8-4bb0-b276-87a0291647a5 admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:08.923987 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1460/2895] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jun 15 15:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 15:03:08.928331 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:08.939223 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e03f3f-ea35-42be-9b70-6ce8434376a5 admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:08.943982 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:08.944866 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:08.945155 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:08.945437 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] PATH_INFO: `/v3/projects/5bca5779ff644630af2e4bfeb5b0cbe6/users/6d48a839a5734485928c45e23cd9b936/roles/9c471d3de2704894a7e696d1506c0e16` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:08.961014 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bca5779ff644630af2e4bfeb5b0cbe6, user_id=6d48a839a5734485928c45e23cd9b936, role_id=9c471d3de2704894a7e696d1506c0e16)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:08.963673 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:09.024060 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1436/2896] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jun 15 15:03:08 2022] PUT /identity/v3/projects/5bca5779ff644630af2e4bfeb5b0cbe6/users/6d48a839a5734485928c45e23cd9b936/roles/9c471d3de2704894a7e696d1506c0e16 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 15:03:09.035870 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] REQUEST_METHOD: `POST` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:09.036161 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:09.036439 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:09.063828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.auth.core [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] MFA Rules not processed for user `6d48a839a5734485928c45e23cd9b936`. Rule list: `[]` (Enabled: `True`). {{(pid=87017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:03:09.065479 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:09.130612 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1461/2897] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:03:09.142240 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:09.144161 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:09.165906 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:09.203495 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c1a7-6445-45d5-a009-8b034c963c0a admin admin] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:09.208086 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146205bc397741d2b8c8d69f94523b0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:09.208725 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] REQUEST_METHOD: `GET` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:09.209009 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:09.209295 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:09.218007 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:09.220120 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2957e-8439-48e7-9cdd-c7b96b94b894 service cinder] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:09.229617 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1437/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:03:09.254675 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:09.274748 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:09.319885 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aea7b9-40ea-4930-be81-5765ff4ad026 None None] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:09.324495 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:09.325371 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:09.325653 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:09.325926 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] PATH_INFO: `/v3/users/6d48a839a5734485928c45e23cd9b936` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:09.327150 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d48a839a5734485928c45e23cd9b936)` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:09.329758 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:09.508450 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d48a839a5734485928c45e23cd9b936'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:09.515481 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d48a839a5734485928c45e23cd9b936'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:09.516742 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d48a839a5734485928c45e23cd9b936'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:09.528473 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d48a839a5734485928c45e23cd9b936'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:09.529124 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.notifications [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d48a839a5734485928c45e23cd9b936'} {{(pid=87017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:09.626730 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1462/2899] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jun 15 15:03:09 2022] DELETE /identity/v3/users/6d48a839a5734485928c45e23cd9b936 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:03:09.631413 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] REQUEST_METHOD: `POST` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:09.631959 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:09.632091 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:09.650510 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.auth.core [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] MFA Rules not processed for user `454ed721dbd84dcaa08428c7e40647f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87016) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 15:03:09.651744 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:09.712624 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1438/2900] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jun 15 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 15:03:09.722760 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:09.724249 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:09.785828 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef96d6-911b-4732-bd7e-aa2fae70186b admin admin] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:09.789455 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b24c24b909be4ce0aacd6b0fb765a637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:09.790133 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:09.790413 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:09.790686 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:09.799630 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:09.801104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:09.815269 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1463/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 15:03:10.258998 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] Authenticating user token {{(pid=87016) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:03:10.260613 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.fernet_utils [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87016) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:03:10.274539 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660622-7a1c-4077-b91b-a23cc351ec08 None None] Validating token access rules against request {{(pid=87016) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:03:10.281151 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ed721dbd84dcaa08428c7e40647f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e584b507784426894a201cd6de6602d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87016) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:03:10.283032 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:03:10.283227 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:03:10.283463 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] PATH_INFO: `/v3/projects/5bca5779ff644630af2e4bfeb5b0cbe6` {{(pid=87016) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:03:10.284779 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bca5779ff644630af2e4bfeb5b0cbe6)` {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:03:10.286686 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] RBAC: Authorization granted {{(pid=87016) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:03:10.418126 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bca5779ff644630af2e4bfeb5b0cbe6', 'request_id': 'req-9b9a9797-f963-42ea-a028-194042630dfa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:10.497418 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bca5779ff644630af2e4bfeb5b0cbe6', 'request_id': 'req-9b9a9797-f963-42ea-a028-194042630dfa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:10.505012 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bca5779ff644630af2e4bfeb5b0cbe6', 'request_id': 'req-9b9a9797-f963-42ea-a028-194042630dfa'} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:10.515676 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] The token cache is being invalidate because project 5bca5779ff644630af2e4bfeb5b0cbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87016) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 15:03:10.515991 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:10.517325 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG keystone.notifications [None req-9b9a9797-f963-42ea-a028-194042630dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87016) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 15:03:10.518970 dv-cinder-787296-10-smb devstack@keystone.service[87016]: [pid: 87016|app: 0|req: 1439/2902] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jun 15 15:03:10 2022] DELETE /identity/v3/projects/5bca5779ff644630af2e4bfeb5b0cbe6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 15:03:19.810004 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:20.512689 dv-cinder-787296-10-smb devstack@keystone.service[87016]: DEBUG dbcounter [-] [87016] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:56.223733 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] Authenticating user token {{(pid=87017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 15:07:56.225458 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:07:56.584415 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910aaa3-1655-4c39-b11a-b74dcf87674d service neutron] Validating token access rules against request {{(pid=87017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 15:07:56.657285 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af660e04a05a45cfa3db0713712ddc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff3430f8f94c209683f9eff4724b35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 15:07:56.657957 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] REQUEST_METHOD: `GET` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 15:07:56.658240 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] SCRIPT_NAME: `/identity` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 15:07:56.658514 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 15:07:56.660416 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.fernet_utils [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 15:07:56.673104 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 15:07:56.674727 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b949c-a6d0-485c-94ef-20ee23a32e16 service placement] RBAC: Authorization granted {{(pid=87017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 15:07:56.687165 dv-cinder-787296-10-smb devstack@keystone.service[87017]: [pid: 87017|app: 0|req: 1464/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jun 15 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 15:08:06.681583 dv-cinder-787296-10-smb devstack@keystone.service[87017]: DEBUG dbcounter [-] [87017] Writing DB stats keystone:SELECT=89 {{(pid=87017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}